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ABSTRACT 

MINOS/AUGMENTED  is  a  general  purpose  nonlinear  programming  system, 
designed  to  solve  large-scale  optimization  problems  involving  sparse  linear  and 
nonlinear  constraints.  Any  nonlinear  functions  appearing  in  the  objective  or  the 
constraints  must  be  continuous  and  smooth.  Users  specify  these  functions  and 
their  gradients  using  two  Fortran  subroutines.  The  remaining  constraint  infor¬ 
mation  is  specified  in  standard  MPS  format,  as  for  regular  linear  programming 
models. 

MINOS/AUGMENTED  (alias  MINOS  Version  4.0)  employs  a  projected  aug¬ 
mented  Lagrangian  algorithm  to  solve  problems  with  nonlinear  constraints.  This 
involves  a  sequence  of  sparse,  linearly  constrained  subproblems,  which  are  solved 
by  a  reduced-gradient  algorithm  as  implemented  in  the  earlier  version  of  MINOS. 

This  manual  supplements  Report  SOL  77-9,  the  MINOS  User’s  Guide. 
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1.  INTRODUCTION 


1.1,  Scops  of  the  Manual 

^^The  scope  of  this  manual  is  restricted  to  matters  additional  to  those  covered 
in  the  MINOS  User’s  Guide  [2].  We  assume  that  you  are  either  already  familiar 
with  that  manual,  or  at  least  have  a  copy  at  hand  to  refer  to.  \ 


1.2  Linear  Programming 


\  Unless  nonlinearities  are  specified,  MINOS/AUGMENTED  solves  the  standard 
linear  programming  problem,  using  a  reliable  implementation  of  the  revised 
simplex  method.  (A  sparse  LU  factorization  of  the  basis  matrix  is  computed 
using  the  “bump  and  spike”  algorithm  of  Hellerman  and  Rarick,  and  this  is 
updated  in  a  stable  manner  by  the  method  of  Bartels  and  Golub.) 


1.3  Nonlinear  Objective 

Similarly,  unless  some  nonlinear  constraints  are  specified  in  the  SPECS  file,  the 
system  will  use  a  reduced-gradient  algorithm  to  solve  the  linearly  constrained 
nonlinear  programming  problem,  as  in  the  earlier  version  of  MINOS  [2], [3]. 


1.4  Nonlinear  Constraints 

When  nonlinear  constraints  exist,  the  optimization  procedure  used  by  MINOS/ 
AUGMENTED  is  one  that  treats  linear  constraints  and  bounds  specially,  but 
does  not  necessarily  satisfy  the  nonlinear  constraints  until  an  optimal  point  is 
reached.  This  means  that  functions  involved  in  the  constraints  may  need  to  be 
defined  outside  the  region  of  interest. 

The  nature  of  the  solution  process  itself  can  be  summarized  as  follows.  A 
sequence  of  “major  iterations”  is  performed,  each  one  requiring  the  solution  of 
a  linearly  constrained  subproblem.  The  subproblems  contain  the  original  linear 
constraints  and  bounds,  as  well  as  linearized  versions  of  the  nonlinear  constraints. 

It  is  safe  to  assume  that  the  objective  function  will  never  be  evaluated  at  a 
point  i  unless  that  point  satisfies  the  linear  constraints  and  the  bounds  on  the 
variables. 

Similarly,  the  constraint  functions  will  almost  never  be  evaluated  unless  the 
linear  constraints  and  bounds  are  satisfied.  The  principal  exception  to  this  rule 
is  the  very  first  point  xo  (which  may  optionally  be  specified  by  the  user).  The 
nonlinear  constraint  functions  will  be  evaluated  at  Xq  regardless  of  feasibility. 


2 


MINOS/AUGMENTED 


§1 


These  matters  must  be  borne  in  mind  during  the  formulation  of  a  nonlinear 
program  (see  below).  The  main  point  to  remember  is  that  the  nonlinear  con¬ 
straints  may  be  violated  during  the  solution  process. 


l.S  Additional  lliar-supplied  Information 

Most  of  the  data  for  a  problem  is  provided  by  means  of  the  MPS  file.  This 
contains  linear  objective  and  constraint  data  in  a  format  that  is  compatible  with 
existing  mathematical  programming  systems. 

If  the  problem  has  a  nonlinear  objective  function,  the  user  provides  a  Fortran 
subroutine,  CALCFG,  to  compute  the  function  and  its  gradient. 

Similarly,  if  the  problem  has  any  nonlinear  constraints,  the  user  provides  a 
Fortran  subroutine,  CALCON,  to  compute  the  nonlinear  terms  and  their  gradients. 
Input  data  is  processed  in  the  following  order: 

•  The  SPECS  file 

•  The  MPS  file 

•  A  basis  file  (optional) 

•  Data  read  by  CALCON  on  its  first  entry 

•  Data  read  by  CALCFG  on  its  first  entry 

•  Data  read  by  CALCFG  on  its  last  entry 

•  Data  read  by  CALCON  on  its  last  entry 

This  order  is  important  if  all  the  data  is  stored  in  the  same  input  stream.  For 
large  problems  the  MPS  data  will  usually  be  in  a  file  of  its  own.  Three  types  of 
basis  file  may  be  input  (and  output),  and  again,  any  that  is  used  will  normally 
be  on  a  file  of  its  own. 


1.6  Problem  Formulation 

In  general,  it  is  worthwhile  expending  considerable  prior  analysis  to  make  your 
constraints  as  near  to  linear  as  possible.  Sometimes  a  simple  transformation 
will  suffice.  For  example,  a  pipeline  optimization  problem  has  pressure  drop 
constraints  of  the  form 


Kx 

d4.814 


+ 


k2 

d4.8i4 


where  d,-  are  the  design  variables  (pipe  diameters)  and  the  other  terms  are 
constant.  These  constraints  are  highly  nonlinear,  but  by  re-defining  the  decision 
variables  to  be  x%  =  1/d4,814  we  can  make  the  constraints  linear.  Even  if  the 
objective  function  becomes  more  nonlinear  by  such  a  transformation,  and  this 
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usually  happens,  the  advantages  of  having  linear  constraints  greatly  outweigh 
this. 

Similarly,  it  is  important  not  to  take  nonlinearities  out  of  the  objective 
function  into  the  constraints.  Thus,  we  would  not  replace 

minimize  /°(z) 

by 

minimize  z  subject  to  f°(z)  —  z  —  0. 

Scaling  is  a  very  important  matter  during  problem  formulation.  A  general 
rule  is  to  scale  both  the  data  and  the  variables  to  be  as  close  to  1.0  as  possible. 
When  conflicts  arise,  one  should  again  sacrifice  the  objective  function  in  favor  of 
the  constraints.  Real-world  problems  tend  to  have  a  natural  scaling  within  each 
constraint,  as  long  as  the  variables  are  expressed  in  consistent  physical  units. 
Hence  it  is  often  sufficient  to  apply  a  scale  factor  to  each  row. 

Finally,  upper  and  lower  bounds  on  the  variables  (and  on  the  constraints) 
are  extremely  useful  in  confining  the  region  over  which  optimization  has  to  be 
performed.  If  sensible  values  are  known,  they  should  always  be  used.  They  are 
also  important  for  avoiding  singularities  in  the  problem  functions.  For  safety 
when  such  singularities  exist,  the  initial  point  z0  discussed  above  should  lie 
within  the  bounds. 


1.7  Restrictions 

The  algorithm  used  in  MINOS/AUGMENTED  is  designed  to  find  solutions  that 
are  locally  optimal.  The  nonlinear  functions  in  a  problem  must  be  smooth,  and 
their  first  derivatives  must  be  computable.  The  functions  need  not  be  separable. 
Integer  restrictions  cannot  be  imposed  directly. 

A  certain  region  is  defined  by  the  linear  constraints  in  a  problem  and  by 
the  bounds  on  the  variables.  If  the  nonlinear  objective  and  constraint  functions 
are  convex  within  this  region,  any  optimal  solution  obtained  will  be  a  global 
optimum.  Otherwise  there  may  be  several  local  optima,  and  some  of  these  may 
not  be  global.  In  such  cases  the  chances  of  finding  a  global  optimum  are  usually 
increased  by  choosing  a  starting  point  that  is  “sufficiently  close”,  but  there  is 
no  general  procedure  for  determining  what  “close”  means,  or  for  verifying  that 
a  given  local  optimum  is  indeed  global. 

MINOS/AUGMENTED  uses  one  large  array  of  main  memory  for  most  of 
its  working  storage.  The  length  of  this  array  may  need  to  be  adjusted  to 
suit  a  particular  problem,  but  otherwise  the  implementation  places  no  intrinsic 
limitation  on  problem  size. 

Nevertheless,  some  a  priori  knowledge  of  a  particular  application  should 
indicate  whether  or  not  the  algorithm  is  likely  to  be  efficient.  Suppose  there 
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are  to  general  constraints  and  n  -j-  to  variables  (including  to  ‘slacks”),  with 
upper  and  lower  bounds  on  all  variables.  In  an  optimal  solution  there  will  be 
to  ‘basic*  variables  and  a  “superbasic”  variables  that  are  strictly  between  their 
bounds.  (The  remaining  ‘nonbasic”  variables  will  be  equal  to  one  of  their 
bounds.)  Ideally  s  should  be  small.  If  it  seems  likely  that  s  will  be  larger 
than  about  200,  some  aggregation  or  reformulation  of  the  problem  should  be 
considered. 

Note  that  8  will  never  be  larger  than  the  number  of  variables  that  occur 
nonlinearly  in  the  problem.  More  importantly,  a  is  often  very  much  less  than 
this  upper  bound.  The  question  to  ask  is  ‘How  many  variables,  including  slacks, 
are  likely  to  be  equal  to  one  of  their  bounds  in  the  optimal  solution?”  Subtracting 
this  number  from  n  will  give  the  required  estimate  of  a.  (This  value  should 
then  be  specified  by  both  the  SUPERBASICS  LIMIT  and  the  HESSIAN  DIMENSION 
keywords  in  the  SPECS  file.) 


1 

1 

F 
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2.1  Statement  of  the  Problem 

The  problem  to  be  solved  must  be  expressed  in  the  following  standard  form: 


minimize 

/°(z)  +  cTx  +  dTv 

(i) 

subject  to 

f{z)  +  Axy  =  \>u 

(2) 

AsX  +  A&y  =  &2> 

(3) 

( *  [;]  ^ ». 

(4) 

where 

‘  /*(*) 

/(*)  =  : 

and  the  functions  /‘(z)  are  smooth  and  hare  known  gradients.  The  components 
of  z  are  called  the  nonlinear  rariables,  and  they  must  be  the  first  set  of  unknowns. 
Similarly,  constraints  (2)  are  called  the  nonlinear  constraints  and  they  must 
appear  before  the  linear  constraints  (3). 

All  types  of  inequality  are  allowed  in  the  general  constraints.  Thus,  the  “=” 
sign  in  (2)  and  (3)  may  mean  “<”  or  “>”  or  “free”  for  individual  rows. 

Upper  and  lower  bounds  (4)  may  be  specified  for  all  variables,  and  similar 
bounds  (ranges)  may  be  defined  for  the  general  constraints. 

2.2  Solution  Technique 

The  solution  process  [4], [5]  consists  of  a  sequence  of  “major  iterations.”  At  the 
start  of  each  major  iteration,  the  nonlinear  constraints  are  linearized  at  the 
current  point  z*.  This  just  means  that  /(z)  in  equation  (2)  is  replaced  by  the 
approximation 

/(Z,  Zk)  =  f{xk)  +  J[xk){x  —  Zfc), 
which  we  shall  write  as 

/=  fk  +  —  **)• 

Here,  J(x )  is  the  Jacobian  matrix  whose  sj-th  element  is  df*(x)/dxj. 


(5) 
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The  objective  function  is  also  modified,  giving  the  following  subproblem: 


minimize  f°(x)  +  cTx  +  dTy  —  \l{f  —  /)  +  - p{f  —  f)T{f  —  f)  (6) 


subject  to  /  -j-  A\y  =  &i, 

A2X  +  A3I/  =  &2j 

r*i 


1  < 


<  u . 


(7) 

(8) 


The  objective  function  (6)  is  called  an  augmented  Lagrangian.  The  vector  X*  is 
an  estimate  of  the  Lagrange  multipliers  for  the  nonlinear  constraints,  and  the 
term  involving  p  is  a  modified  quadratic  penalty  function. 

Using  (5),  we  can  see  that  the  linear  constraints  (7)  and  (8)  take  the  form 


Jk 

Ai 

X 

bl  +  Jk^k  —  fk 

A*. 

y 

Since  MINOS  takes  advantage  of  sparsity  within  the  constraint  matrix,  it  is  clear 
that  a  sparse  Jacobian  matrix  J *  can  be  handled  efficiently. 


2.3  Choice  of  X* 

Two  choices  of  X*  are  allowed,  according  to  the  LAGRANGIAN  keyword  in  the 
SPECS  file.  The  choice  LAGRANGIAN  =  NO  sets  both  X*  =  0  and  p  =  0,  and 
corresponds  to  simple  sequential  linearization  of  the  nonlinear  constraints,  with 
no  modification  to  the  original  objective  function.  This  choice  is  not  usually 
recommended,  since  convergence  cannot  be  guaranteed  in  general. 

The  preferred  option  is  LAGRANGIAN  =  YES.  In  this  case  X*  will  be  set  to  the 
first  mi  “simplex  multipliers”  from  the  previous  subproblem  (except  Xo  is  zero, 
or  may  be  specified  by  the  user).  The  vectors  X*  should  converge  to  the  Lagrange 
multipliers  for  the  original  nonlinear  constraints.  The  final  X*  will  appear  in  the 
ROVS  section  of  the  printed  solution  under  the  heading  DUAL  ACTIVITY. 


2.4  Choice  of  p 

When  LAGRANGIAN  =  YES,  the  penalty  parameter  p  may  also  be  specified,  and 
this  may  be  essential  to  obtain  convergence.  Some  advice  for  setting  p  is  given 
under  PENALTY  PARAMETER  in  section  4.1.  In  many  cases,  p  =  0  will  give  the 
most  rapid  rate  of  convergence,  but  for  highly  nonlinear  problems  a  positive 
value  is  recommended. 
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2.5  Convergence  Condition* 

Broadly  speaking,  if  z*  is  an  optimal  solution  to  the  fc-th  subproblem,  and  if  it 
satisfies  the  nonlinear  constraints  sufficiently  well,  then  Xk+i  (the  solution  to  the 
next  subproblem)  will  probably  be  an  optimal  solution  to  the  original  nonlinear 
program. 

More  precisely,  let  (2*,  A*)  be  the  final  solution  and  multiplier  estimates 
that  result  from  solving  the  fc-th  subproblem.  The  next  subproblem  is  defined  in 
terms  of  2*  and  A*,  and  will  terminate  at  some  point  (z*-|-i,  A*+i).  Convergence 
is  assumed  to  have  occurred  if  the  following  conditions  are  true: 

2*  is  an  optimal  solution  to  its  subproblem; 

2/t  satisfies  the  nonlinear  constraints  to  within  a  specified  tolerance  eT; 

A*  is  not  substantially  different  from  A*_i; 

2fc_|_i  is  an  optimal  solution  to  its  subproblem; 

a  basis  change  did  not  occur  during  solution  of  subproblem  k- -f-  1; 

the  reduced  gradient  did  not  increase  significantly  during  solution  of  that 

subproblem. 

If  all  these  conditions  hold,  (2*+!,  A*^_i)  will  be  accepted  as  an  optimal  solution 
to  the  original  problem. 

The  point  to  remember  here  is  that  z*  is  checked  for  feasibility  and  then  the 
final  point  zfc+1  is  checked  for  optimality.  Normally,  very  few  minor  iterations 
will  occur  on  the  last  subproblem  (ideally  none).  Hence  the  last  two  subproblem 
solutions  zjt  and  zje-t-i  will  be  virtually  identical,  and  therefore  the  tests  for 
feasibility  and  optimality  will  have  been  applied  to  essentially  the  same  point. 
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S.  FUNCTION  ROUTINES 


3.1  Subroutine  CALCFG 

This  subroutine  is  provided  by  the  user  to  calculate  the  objective  function  f°[z) 
and  its  gradient  g°{z).  It  remains  essentially  the  same  as  in  the  earlier  version 
of  MINOS,  but  an  option  now  exists  for  allowing  MINOS  to  calculate  some  of 
the  components  of  g°(z)  by  finite  differences. 

CALCFG  is  not  needed  if  the  objective  function  is  entirely  linear. 


Specification: 

SUBROUTINE  CALCFG (  MODE,  N,  X.  F,  G,  NSTATE,  NPROB  ) 

IMPLICIT  REAL*8(A-H,0-Z) 

DIMENSION  X(N) .  G(N) 

(The  IMPLICIT  statement  should  not  be  used  on  machines  for  which  single¬ 
precision  floating-point  is  adequate;  e.g.  Burroughs  and  CDC.) 


Parameters: 

MODE  (Input)  If  DERIVATIVE  LEVEL=i  or  3,  the  value  of  MODE  can  be  ignored; 

it  will  always  be  2.  You  have  undertaken  to  compute  all  gradient 
components.  (This  is  highly  recommended.) 

If  DERIVATIVE  LEVEL=0  or  2,  there  are  two  relevant  input  values,  and 
you  must  test  MODE  to  decide  what  to  do: 

If  M0DE=2,  compute  the  objective  value  F,  and  as  many  components 
of  G  as  you  can. 

If  M0DE=0,  compute  the  objective  value  F,  but  do  not  alter  any  of 
the  components  of  G. 

(Output)  If  for  some  reason  you  wish  to  terminate  solution  of  the 
current  problem,  set  MODE  to  a  negative  value,  e.g.  -1. 

N  (Input)  The  number  of  variables  involved  in  f°(z).  These  must  be  the 

first  N  variables  in  the  problem. 

X(N)  (Input)  An  array  of  dimension  N  containing  the  current  values  of  the 
nonlinear  variables  z. 

F  (Output)  The  computed  value  of  f°(z). 
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G(N)  (Output)  The  computed  gradient  rector  gQ{x).  For  each  relevant  j, 
G  O')  should  contain  the  partial  derivative  df°/dxj  (except  if  M0DE=O 
—  see  above). 

NSTATE  (Input)  If  NSTATE=0,  there  is  nothing  special  about  the  current  call  to 
CALCFG. 

If  NSTATE=1,  this  is  the  first  call  to  CALCFG.  Some  data  may  need  to  be 
input  or  computed  and  saved  in  local  or  COMMON  storage,  for  use  in  the 
present  and  subsequent  calls  to  CALCFG. 

If  NSTATE=2,  the  current  solution  in  X  has  been  determined  to  be 
optimal.  You  may  wish  to  perform  some  additional  computation  on 
this  solution.  (This  ease  will  not  arise  unless  the  CALL  keyword  is 
used  in  the  SPECS  file.) 

NPROB  (Input)  An  integer  that  can  be  set  by  a  card  of  the  form  PROBLEM 
NUMBER  n  in  the  SPECS  file. 


3.2  Subroutine  CALCON 

This  subroutine  is  provided  by  the  user  to  compute  the  nonlinear  constraint 
functions  f(x)  and  the  corresponding  Jacobian  matrix  J{x).  Recall  that  the  j'-th 
column  of  J{x )  is  defined  to  be  df/dij. 

CALCON  may  be  coded  in  two  different  ways,  depending  on  the  method  used 
for  storing  the  Jacobian. 

JACOBIAN  =  DENSE 

Specification: 

SUBROUTINE  CALCON (  MODE,  M,  N,  NJAC,  X,  F,  G,  NSTATE,  NPROB  ) 
IMPLICIT  REAL#8(A-H, Q-Z) 

DIMENSION  X(N) ,  F (M) ,  G(M,N) 

Parameters: 

MODE  (Input)  Options  not  implemented. 

(Output)  If  for  some  reason  you  wish  to  terminate  solution  of  the 
current  problem,  set  MODE  to  a  negative  value,  e.g.  -1. 

M  (Input)  The  number  of  nonlinear  constraints,  not  counting  the  objective 

function.  These  must  be  the  first  M  constraints  in  the  problem. 
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N  (Input)  The  number  of  variables  involved  in  f(x).  These  must  be  the 

first  N  variables  in  the  problem. 

NJAC  (Input)  The  value  M*N.  (This  may  or  may  not  be  useful.) 

X(N)  (Input)  An  array  of  dimension  N  containing  the  current  values  of  the 

nonlinear  variables  x. 

F(M)  (Output)  The  computed  value  of  the  constraint  vector  f(x). 

G(M,N)  (Output)  The  computed  Jacobian  matrix  J{x).  The  y-th  column  of 
J(x)  should  be  stored  in  the  y-th  column  of  the  2-dimensional  array  G. 
Equivalently,  the  gradient  of  the  i-th  constraint  should  be  stored  in  the 
i-th  row  of  G.  Any  constant  elements  that  were  specified  in  the  MPS 
file  need  not  be  reset  here.  This  includes  elements  that  are  identically 
zero. 

Caution:  Even  if  an  element  Jij  is  constant  (and  nonzero),  it  still 
enters  into  the  calculation  of  the  i-th  constraint.  In  fact,  the  value 
G(i,j')*X(y)  should  be  added  to  F (*) . 

NSTATE  (Input)  If  NSTATE=0,  there  is  nothing  special  about  the  current  call  to 
CALCON. 

If  NSTATE=1,  this  is  the  first  call  to  CALCON.  Some  data  may  need  to  be 
input  or  computed  and  saved  in  local  or  COMMON  storage,  for  use  in  the 
present  and  subsequent  calls  to  CALCON. 

If  NSTATE=2,  the  current  solution  in  X  has  been  determined  to  be 
optimal.  You  may  wish  to  perform  some  additional  computation  on 
this  solution.  (As  with  subroutine  CALCFG,  this  case  will  not  arise 
unless  the  CALL  keyword  appears  in  the  SPECS  file.) 

NPROB  (Input)  An  integer  that  can  be  set  by  a  card  of  the  form  PROBLEM 
NUMBER  n  in  the  SPECS  file. 


JACOBIAN  =  SPARSE 


Specification: 

SUBROUTINE  CALCON (  MODE,  M,  N,  NJAC,  X,  F,  G,  NSTATE,  NPROB  ) 
IMPLICIT  REALMS (A-H.O-Z) 

DIMENSION  X(N) ,  F(M) ,  G(NJAC) 

This  is  the  same  as  for  JACOBIAN  =  DENSE,  except  for  the  declaration  of 
G(NJAC) . 
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Parameters: 

NJAC  (Input)  The  number  of  nonzero  elements  in  the  Jacobian  matrix  J{x). 

This  is  exactly  the  number  of  entries  in  the  MPS  file  that  referred  to 
nonlinear  rows  and  nonlinear  Jacobian  columns. 

Usually  NJAC  will  be  less  than  M*N.  The  actual  value  of  NJAC  may  not 
be  of  any  use  when  coding  CALCON,  but  in  all  cases,  any  expression 
involving  G CO  should  have  the  subscript  i  between  1  and  NJAC. 

G(NJAC)  (Output)  The  computed  elements  of  the  Jacobian  matrix.  These  ele¬ 
ments  must  be  stored  into  G  in  exactly  the  same  position  as  implied 
by  the  MPS  file.  There  is  no  internal  check  for  consistency  (except  in¬ 
directly  via  the  VERIFY  CONSTRAINT  GRADIENTS  option),  so  great  care 

is  essential. 

If  any  element  of  the  Jacobian  is  constant,  and  if  the  correct  value  was 
entered  in  the  MPS  file,  the  corresponding  element  G(0  need  not  be 
reassigned.  (However,  one  of  the  elements  of  F  requires  a  term  of  the 
form  G(0  *X(j) .) 

The  other  parameters  are  the  same  as  for  JACOBIAN  =  DENSE. 

3.3  Reserved  COMMON  Blocks 

When  the  above  subroutines  are  coded,  certain  care  must  be  exercised  to  avoid 
conflict  with  the  coding  of  MINOS.  In  particular,  the  following  labeled  COMMON 
blocks  are  used  internally  by  MINOS: 


ALC0M1 

DJCOM 

INVCOM 

PARMCM 

ALC0M2 

EPSCOM 

IOCOMM 

PRCCOM 

BGCOM 

FILES 

ITNLOG 

PRCCM2 

CGCOM 

FREQS 

ITNLG2 

RGTCLS 

CONVCM 

FXCOM 

LPCOM 

SOLNCM 

CORE 

FXC0M2 

LUFILE 

TOLS 

CYCLCM 

INTCOM 

MPSCOM 

WORDSZ 

These  COMMON  blocks  must  not  be  overwritten. 

In  general  we  recommend  that  blank  COMMON  should  not  be  overwritten 
either.  This  is  because  MINOS  needs  one  large  array  for  workspace,  and  in  some 
installations  it  may  be  convenient  to  store  this  array  in  blank  COMMON  (e.g.  to 
allow  core  to  be  allocated  at  run-time). 

Note  that  on  some  computer  systems  (e.g.  the  Burroughs  B6700),  local  data 
created  by  a  subroutine  may  need  to  be  saved  in  a  COMMON  block  to  ensure  that 
the  data  won’t  “disappear”  on  exit  from  the  subroutine.  In  this  case  it  is  easy 
to  avoid  conflict  with  the  reserved  names. 
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Occasionally  it  may  be  convenient  to  use  data  that  is  stored  in  the  reserved 
COMMON  blocks.  In  particular,  the  declaration 

COMMON  /I0C0MM/  IREAD, IPRINT 

provides  access  to  two  integer  variables  that  define  the  standard  Fortran  reader 
and  printer  files.  When  MINOS  was  originally  compiled  on  your  computer  sys¬ 
tem,  IREAD  and  IPRINT  will  have  been  assigned  the  appropriate  values  (typically 
5  and  6).  These  may  be  used  in  I/O  statements  if  you  wish;  an  example  is  given 
in  section  7.2. 


3.4  Reserved  Subroutine  Names 

MINOS/AUGMENTED  contains  the  subroutines  listed  below.  These  names 
must  not  be  used  for  any  auxiliary  user  routines. 


ADDCOL 

DELCOL 

LOADB 

R1ADD 

ALAUX 

DOT 

LOADN 

R1M0D 

BTRANL 

DRIVER 

LPITN 

R1PR0D 

BTRANU 

DUMPN 

LSOUTC 

R1SUB 

BUMPS 

FACTOR 

MINOS 

SAVEB 

CALCFG 

FGMOD 

MKLIST 

SEARCH 

CALCG 

FORMC 

MODLU 

SETJAC 

CALCON 

FTRANL 

MPS 

SETPI 

CG 

FTRANU 

MPSIN 

SETX 

CHKDIR 

FUNGRD 

NMSRCH 

SOLN 

CHKGRD 

FUNJAC 

PACKLU 

SOLPRT 

CHKJAC 

GETGRD 

PRICE 

SPECS 

CHUZft 

GETPTC 

PRTJAC 

SPECS2 

CHUZR 

GO 

PUNCH 

STATE 

COMDFP 

HASH 

P3 

TRNSVL 

COPYA 

INITLZ 

P4 

UNPACK 

COPYD 

INSERT 

RESETR 

COPYH 

INVERT 

RGITN 

CRASH 

ITEROP 

RTRSOL 

In  addition, 

GETCOR 

is  used  in  the  Burroughs  version  of  MINOS,  and 

MATMOD  MKCOL  MODBND  MODELM 
are  the  subroutines  defined  in  reference  [6]. 
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The  SPECS  file  is  supplied  by  the  user;  it  contains  a  list  of  keywords  and  values 
to  define  various  run-time  parameters.  The  following  keywords  apply  specifically 
to  problems  containing  nonlinear  constraints: 

COMPLETION  PARTIAL  or  FULL 

JACOBIAN  DENSE  or  SPARSE 

LAGRANGIAN  YES  or  NO 
MAJOR  ITERATIONS 
MINOR  ITERATIONS 
NONLINEAR  CONSTRAINTS 
NONLINEAR  OBJECTIVE  VARIABLES 
NONLINEAR  JACOBIAN  VARIABLES 
PENALTY  PARAMETER 
PRINT  LEVEL 
RADIUS  OF  CONVERGENCE 
ROT  TOLERANCE 

The  next  section  describes  the  way  these  keywords  should  be  used.  Also  described 
are  the  following: 

BACKUP  BASIS  FILE 

CALL  FUNCTION  ROUTINES  THEN  OPTIMAL 

CRASH  OPTION 

CYCLE  LIMIT 

DERIVATIVE  LEVEL 

DIFFERENCE  INTERVAL 

MULTIPLE  PRICE 

PHANTOM  COLUMNS 

PIVOT  TOLERANCE 

PRINT  SPIKE  PATTERN 

START  and  STOP  gradient  verification 

SUPPRESS  PARAMETERS 

VERIFY  GRADIENTS 

Some  of  these  keywords  are  new.  The  remainder  were  recognized  by  the  earlier 
version  of  MINOS  but  have  had  their  meaning  expanded. 

Remember  that  the  first  three  characters  of  a  keyword  are  always  significant, 
and  in  some  cases  the  first  four  characters  of  the  next  word  are  also  significant. 
For  example,  in  the  SPECS  card 

NONLINEAR  CONSTRAINTS  100 

both  NON  and  CONS  are  significant. 
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BACKUP  BASIS  FILE  k  (default  it  =  0) 

This  is  intended  as  a  safeguard  against  losing  the  results  of  a  long  run. 
Suppose  that  a  NEI  BASIS  FILE  is  being  saved  every  100  iterations,  and  that 
MINOS  is  about  to  save  such  a  basis  at  iteration  2000.  It  is  conceivable  that 
the  run  may  time-out  during  the  next  few  milliseconds  (i.e.  in  the  middle  of  the 
save),  or  the  host  computer  could  unexpectedly  crash.  In  this  case  the  basis  file 
will  be  corrupted  and  the  run  will  have  been  essentially  wasted. 

To  eliminate  this  risk,  both  a  NEI  BASIS  FILE  and  a  BACKUP  BASIS  FILE 
may  be  specified.  The  following  would  be  suitable  for  the  above  example: 

OLD  BASIS  FILE  10  (or  0) 

NEV  BASIS  FILE  10 

BACKUP  BASIS  FILE  11 
SAVE  FREQUENCY  100 

The  current  basis  will  then  be  saved  every  100  iterations,  first  on  file  10  and  then 
immediately  on  file  11.  If  the  run  is  interrupted  at  iteration  2000  during  the  save 
on  file  10,  there  will  still  be  a  useable  basis  on  file  11  (corresponding  to  iteration 
1900). 

Note  that  a  NEI  BASIS  will  be  saved  at  the  end  of  a  run  if  it  terminates 
normally,  but  there  is  no  need  for  a  further  BACKUP  BASIS.  In  the  above  example, 
if  an  optimum  solution  is  found  at  iteration  2050  (or  if  the  iteration  limit  is  2050), 
the  final  basis  on  file  10  will  correspond  to  iteration  2050,  but  the  last  basis  saved 
on  file  11  will  be  the  one  for  iteration  2000. 


CALL  FUNCTION  ROUTINES  WHEN  OPTIMAL 

This  requests  a  final  call  to  subroutine  CALCFG  and/or  subroutine  CALC0N 
(in  that  order)  when  an  optimal  solution  is  reached.  This  is  the  means  by  which 
the  parameter  value  NSTATE=2  is  obtained.  See  the  specification  of  CALCFG  and 
CALC0N  for  further  details. 


COMPLETION  PARTIAL 
COMPLETION  FULL  (default) 

This  determines  whether  subproblems  should  be  solved  accurately  (full  com¬ 
pletion),  or  whether  each  one  should  be  terminated  somewhat  earlier  (partial 
completion).  MINOS  effects  this  by  using  two  sets  of  convergence  tolerances  for 
the  subproblems. 

Use  of  partial  completion  may  reduce  the  work  during  early  major  iterations 
(unless  the  MINOR  ITERATIONS  limit  is  active).  The  optimal  set  of  basic  and 
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superbasic  variables  will  probably  be  determined  for  any  given  subproblem,  but 
the  reduced  gradient  may  be  larger  than  it  would  have  been  with  full  completion. 

An  automatic  switch  to  full  completion  occurs  when  it  appears  that  the 
sequence  of  major  iterations  is  converging.  The  switch  is  made  when  the  con¬ 
straint  error  is  reduced  below  100er  (where  er  is  specified  by  the  ROI  TOLERANCE 
keyword). 

Full  completion  tends  to  give  better  Lagrange- multiplier  estimates  and  may 
lead  to  fewer  major  iterations. 


CRASH  OPTION  k  (default  ifc  =  l) 

If  a  starting  basis  is  not  specified,  a  triangular  basis  will  be  selected  from 
certain  columns  of  the  constraint  matrix  A,  depending  on  the  value  of  k. 

k  Meaning 

0  The  all-slack  basis  is  set  up. 

1  All  columns  of  A  are  considered. 

2  Only  the  columns  of  A  corresponding  to  the  linear  variables  y  will  be 

considered.  Linear  programming  will  then  be  used  to  optimize  y  as 
much  as  possible,  before  the  nonlinear  variables  x  are  altered  from 
their  initial  values.  This  is  an  important  option. 

3  Nonlinear  objective  variables  will  be  excluded  from  the  initial  basis. 

4  Nonlinear  Jacobian  variables  will  be  excluded  from  the  initial  basis. 

In  all  cases,  CRASH  will  refrain  from  selecting  variables  that  were  made  super- 
basic  by  means  of  an  FX  indicator  in  the  INITIAL  bounds  set. 


CYCLE  LIMIT  l 

CYCLE  PRINT  p 

CYCLE  TOLERANCE  t 

These  keywords  are  documented  elsewhere  (Preckel  [6]).  They  refer  to  a 
facility  for  constructing  and  solving  a  sequence  of  related  problems.  Modules  are 
provided  for  modifying  the  constraint  data  internally,  using  information  obtained 
from  the  previous  problem. 
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DERIVATIVE  LEVEL  d  (default  d  —  3) 

This  specifies  which  nonlinear  function  gradients  are  known  analytically 
and  will  be  supplied  to  MINOS  by  the  user  subroutines  CALCFG  and  CALCON.  The 
values  planned  for  implementation  are  as  follows. 

d  Meaning 

3  All  objective  and  constraint  gradients  are  known. 

2  All  constraint  gradients  are  known,  but  some  or  all  of  the  objective 

gradients  are  unknown. 

1  All  objective  gradients  are  known,  but  some  or  all  of  the  constraint 
gradients  are  unknown. 

0  Some  of  the  objective  gradients  are  unknown  and  some  of  the  constraint 
gradients  are  unknown. 

The  value  d  =  3  should  be  used  whenever  possible.  It  is  the  most  reliable  and 
will  usually  be  the  most  efficient. 

If  d  —  2,  MINOS  will  estimate  the  missing  objective  gradients  by  finite 
differences.  This  may  be  convenient  if  most  of  the  gradient  elements  are  known 
and  are  computed  by  subroutine  CALCFG.  However,  a  special  call  to  CALCFG  is 
required  for  each  missing  element  (this  could  be  expensive),  and  in  general  the 
option  is  not  entirely  reliable.  If  the  nonlinear  variables  are  not  well  scaled,  it 
may  be  necessary  to  specify  a  nonstandard  DIFFERENCE  INTERVAL  (see  below). 

Note:  In  the  present  implementation,  all  constraint  gradients  must  be  pro¬ 
vided  by  subroutine  CALCON.  Hence,  the  options  d  =  0  and  d  =  1  must  not  be 
used  unless  the  constraints  are  entirely  linear. 


DIFFERENCE  INTERVAL  h  (default  h  =  2>/e) 

This  may  be  used  to  alter  the  finite-difference  interval  h  that  is  used  in  the 
following  circumstances: 

1.  In  the  initial  (“cheap”)  phase  of  verifying  the  objective  gradients. 

2.  For  verifying  the  constraint  gradients. 

3.  For  estimating  missing  objective  gradient  elements. 

In  the  last  two  cases,  a  derivative  with  respect  to  Xj  is  estimated  by  perturbing 
that  component  of  x  to  the  value  Xj  -{-  h(l  -J-  |zj|),  and  then  evaluating  f(x)  or 
f°{x)  at  the  perturbed  point.  Judicious  alteration  of  h  may  sometimes  lead  to 
greater  accuracy.  The  machine  precision,  e,  should  always  be  borne  in  mind. 
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JACOBIAN  DENSE 

JACOBIAN  SPARSE  (default) 

This  determines  the  manner  in  which  the  constraint  gradients  are  evaluated 
and  stored.  It  affects  the  MPS  file  and  subroutine  CALCON. 

The  DENSE  option  is  convenient  if  there  are  not  too  many  nonlinear  con¬ 
straints  or  variables.  It  requires  storage  for  three  dense  matrices  of  order  miXni- 
(One  of  these  is  which  forms  part  of  the  constraint  matrix  in  equation  (9).  If 
Jk  is  large  and  dense,  the  basis  factorization  may  contain  an  unnecessarily  large 
“bump”  and  a  large  number  of  “spikes” .) 

When  DENSE  is  specified,  the  MPS  file  may  contain  any  number  of  Jacobian 
entries.  Usually  this  means  no  entries  at  all,  or  else  just  ones  that  remain  constant 
for  all  values  of  the  nonlinear  variables. 

For  efficiency,  the  SPARSE  option  is  preferable  in  all  nontrivial  cases.  The 
MPS  file  must  then  specify  the  position  of  all  nonzero  Jacobian  elements.  See 
section  5.2  for  details. 


LAGRANGIAN  YES  (default) 

LAGRANGIAN  NO 

This  determines  the  form  of  the  objective  function  used  for  the  linearized 
subproblems.  The  default  value  YES  is  highly  recommended.  The  PENALTY 
PARAMETER  value  is  then  also  relevant. 

If  NO  is  specified,  subroutine  CALCON  will  be  called  only  once  per  major 
iteration.  Hence  this  option  may  be  useful  if  the  nonlinear  constraint  functions 
are  very  expensive  to  evaluate.  However,  in  general  there  is  a  great  risk  that 
convergence  may  not  occur. 


MAJOR  ITERATIONS  k  (default  k  —  20) 

This  is  the  maximum  number  of  major  iterations  allowed.  It  is  intended  to 
guard  against  an  excessive  number  of  linearizations  of  the  constraints,  since  in 
some  cases  the  sequence  of  major  iterations  may  not  converge. 

For  preliminary  runs  on  a  new  problem,  a  fairly  low  MAJOR  ITERATIONS 
limit  should  be  specified  (e.g.  10  or  20).  See  the  advice  given  under  PENALTY 
PARAMETER. 


MINOR  ITERATIONS  *  (default  *=  40) 

This  is  the  maximum  number  of  iterations  allowed  between  successive  linear¬ 
izations  of  the  nonlinear  constraints,  not  counting  infeasible  iterations.  A  mod¬ 
erate  value  (e.g.  10  <  k  <  50)  prevents  excessive  effort  being  expended  on  early 
major  iterations,  but  allows  later  subproblems  to  be  solved  to  completion. 
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In  general  it  is  unsafe  to  specify  a  value  as  small  as  k  =  1  or  2.  (Even  when 
an  optimal  solution  has  been  reached,  a  few  minor  iterations  may  be  needed  for 
the  corresponding  subproblem  to  be  recognized  as  optimal.) 

Note  that  an  independent  limit  on  total  iterations  should  be  specified  by 
the  ITERATIONS  keyword  as  usual.  If  the  problem  is  linearly  constrained,  this  is 
the  only  limit  (i.e.  the  MINOR  ITERATIONS  keyword  is  ignored). 


MULTIPLE  PRICE  k  (default  ifc  =  0) 

This  option  should  be  considered  whenever  an  initial  point  is  not  specified. 
If  the  default  value  of  zero  is  used,  only  one  variable  will  be  selected  by  each 
pricing  operation  to  become  superbasic.  Hence  in  general,  if  few  or  no  values 
are  specified  in  the  INITIAL  bounds  set,  or  if  an  OLD  BASIS  FILE  contains  very 
few  superbasics,  MULTIPLE  PRICE  10  or  20  may  be  beneficial  (assuming  the 
problem  is  nonlinear  enough  to  have  a  large  number  of  superbasic  variables  at 
its  solution). 

A  full  description  of  MULTIPLE  PRICE  is  given  in  the  MINOS  User’s  Guide. 


NONLINEAR 

CONSTRAINTS 

mi 

(default 

mi  =0) 

NONLINEAR 

VARIABLES 

»i 

(default 

n  i  =0) 

NONLINEAR 

OBJECTIVE  VARIABLES 

< 

(default 

n'i=0) 

NONLINEAR 

JACOBIAN  VARIABLES 

(default 

»?=  o) 

These  keywords  define  the  parameters  M  and  N  in  subroutines  CALCFG  and 
CALCON.  For  example,  M  in  CALCON  will  take  the  value  mi,  if  mi  >  0. 

If  the  objective  function  and  the  constraints  involve  the  same  set  of  nonlinear 
variables  x,  then  NONLINEAR  VARIABLES  n\  is  the  simplest  way  to  set  N  to  be 
the  same  value  for  both  subroutines.  Otherwise,  the  NONLINEAR  OBJECTIVE  and 
NONLINEAR  JACOBIAN  keywords  should  be  used  to  specify  n\  and  n'[  separately. 

Remember  that  the  nonlinear  constraints  and  variables  must  always  be  the 
first  ones  in  the  problem.  It  is  usually  best  to  place  Jacobian  variables  before 
objective  variables,  so  that  v!{  <  n\  (unless  n\  =  0).  This  affects  the  way  the 
function  subroutines  should  be  programmed,  and  the  order  in  which  variables 
should  be  placed  in  the  COLUMNS  section  of  the  MPS  file. 


PENALTY  PARAMETER  p  (default  p  =  100.0/m!) 

This  is  the  value  of  p  in  the  modified  augmented  Lagrangian  (equation  (8) 
in  section  2.2).  It  is  used  only  if  LAGRANGIAN  YES  is  specified. 
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For  early  runs  on  a  problem  with  unknown  characteristics,  something  like 
the  default  value  should  be  specified.  In  general,  a  positive  value  of  p  may  be 
necessary  to  ensure  convergence,  but  on  the  other  hand,  if  the  value  is  too  large, 
the  rate  of  convergence  may  be  slow. 

If  the  objective  function  and  the  constraints  are  known  to  be  convex,  a 
zero  penalty  is  best  (specify  PENALTY  PARAMETER  0.0).  This  value  may  also  be 
satisfactory  in  the  non-convex  case,  if  the  functions  are  not  highly  nonlinear. 

In  general,  if  several  related  problems  are  to  be  solved,  the  following  strategy 
for  setting  the  PENALTY  PARAMETER  may  be  useful: 

1.  Initially,  use  a  moderate  value  of  p,  such  as  the  default,  and  a  reasonably  low 
MAJOR  ITERATIONS  and/or  (total)  ITERATIONS  limit. 

2.  If  successive  major  iterations  appear  to  be  terminating  with  radically  different 
solutions,  the  penalty  parameter  should  be  increased. 

3.  If  there  appears  to  be  little  progress  between  major  iterations,  the  penalty 
parameter  could  be  reduced. 


PHANTOM  COLUMNS  c 

PHANTOM  ELEMENTS  e 

See  Preckel  [6]. 

PIVOT  TOLERANCE  t  (default  t  =  y/e) 

This  allows  the  pivot  tolerance  to  be  altered  if  necessary.  (The  tolerance 
is  used  to  prevent  columns  entering  the  basis  if  they  would  cause  the  basis  to 
become  almost  singular.)  The  default  value  of  t  is  the  square  root  of  the  machine 
precision  (roughly  10~8  for  double  precision  on  IBM  systems).  This  should  be 
satisfactory  in  most  circumstances. 


PRINT  LEVEL  p  (default  p  =  l) 

This  varies  the  amount  of  information  that  will  be  output  to  the  printer  file. 
It  is  independent  of  the  LOG  FREQUENCY.  Typical  values  are 

PRINT  LEVEL  1 

which  gives  normal  output  for  linear  and  nonlinear  problems,  and 

PRINT  LEVEL  11 

which  in  addition  gives  the  values  of  the  nonlinear  variables  z*  at  the  start  of 
each  major  iteration,  for  problems  with  nonlinear  constraints. 

In  general,  the  value  being  specified  is  best  thought  of  as  a  binary  number 
of  the  form 

PRINT  LEVEL  JFLXI 

where  each  letter  stands  for  a  digit  that  is  either  0  or  1.  The  quantities  referred 
to  are: 


i 
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I  INVERT  statistics,  i.e.  information  relating  to  the  basis  matrix  when¬ 
ever  it  is  refactorized. 

X  Zk,  the  nonlinear  variables  involved  in  the  objective  function  or  the 
constraints. 

L  Xfc,  the  Lagrange-multiplier  estimates  for  the  nonlinear  constraints. 
(Suppressed  if  the  option  LAGRANGIAN  NO  is  specified,  since  \k  =  0 
then.) 

F  f{zk),  the  values  of  the  nonlinear  constraint  functions. 

J  J{xk),  the  Jacobian  matrix. 

To  obtain  output  of  any  item,  set  the  corresponding  digit  to  1,  otherwise  to  0. 

If  J=l,  the  Jacobian  matrix  will  be  output  column- wise  at  the  start  of  each 
major  iteration.  Column  j  will  be  preceded  by  the  value  of  the  corresponding 
variable  Zj  and  a  key  to  indicate  whether  the  variable  is  basic,  superbasic  or 
nonbasic.  (Hence  if  J=l,  there  is  no  reason  to  specify  X=1  unless  the  objective 
contains  more  nonlinear  variables  than  the  Jacobian.)  A  typical  line  of  output 
is 

3  1.250000D+01  BS  1  1.00000E+00  4  2.00000E+00 

which  would  mean  that  is  basic  at  value  12.5,  and  the  third  column  of  the 
Jacobian  has  elements  of  1.0  and  2.0  in  rows  1  and  4. 

PRINT  LEVEL  0  may  be  used  to  suppress  most  output,  including  page  ejects 
between  major  iterations.  (Error  messages  will  not  be  suppressed.)  This  print 
level  should  be  used  only  for  production  runs  on  well-understood  models.  A  high 
LOG  FREQUENCY  may  also  be  appropriate  for  such  cases,  e.g.  100  or  1000.  (For 
convenience,  LOG  FREQUENCY  0  may  be  used  as  shorthand  for  LOG  FREQUENCY 
99999.) 


PRINT  SPIKES 

This  invokes  an  option  for  displaying  the  bump  and  spike  structure  of  the 
basis  matrix  each  time  it  is  refactorized. 


RADIUS  OF  CONVERGENCE  r  (default  r  =  0.0 1) 

This  determines  when  the  penalty  parameter  p  will  be  reset  to  zero  (if  ini¬ 
tialized  to  a  positive  value).  Both  the  nonlinear  constraint  error  (see  ROW  ERR 
below)  and  the  relative  change  in  consecutive  Lagrange  multipler  estimates  must 
be  less  than  r  at  the  start  of  a  major  iteration  before  p  is  set  to  zero.  Thereafter 
the  sequence  of  major  iterations  should  converge  quadratically  to  an  optimum. 


KEYWORDS 
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ROI  TOLERANCE  er  (default  eT  =  1.0E-6) 

This  specifies  how  accurately  you  want  the  nonlinear  constraints  to  be 
satisfied.  (Both  ROV  and  TOLE  are  significant  on  this  data  card.)  The  default 
value  of  1.0E-6  is  usually  appropriate,  since  the  MPS  file  usually  contains  data 
to  about  that  accuracy. 

Let  ROWERR  be  defined  as  the  maximum  component  of  the  residual  vector 
/(x)  Aiy  —  &i,  normalized  by  the  size  of  the  solution.  Thus, 

ROWERR  =  ||  f(x)  +  Aiy  -  61||0o/||(x, y) |U. 

The  solution  {x,y)  is  regarded  as  acceptably  feasible  if  ROWERR  <  er. 

If  some  of  the  data  in  your  problem  is  known  to  be  of  low  accuracy,  a  larger 
ROI  TOLERANCE  may  be  appropriate.  Bear  in  mind,  however,  that  non-convex 
problems  may  need  a  nonzero  PENALTY  PARAMETER  p,  and  that  p  is  automatically 
reset  to  zero  if  ROWERR  <  100er). 


START  OBJECTIVE  CHECK  AT  VARIABLE  k 

START  CONSTRAINT  CHECK  AT  VARIABLE  k 

STOP  OBJECTIVE  CHECK  AT  VARIABLE  l 

STOP  CONSTRAINT  CHECK  AT  VARIABLE  l 

These  keywords  may  be  used  to  abbreviate  the  verification  of  gradient 
elements  computed  by  subroutines  CALCFG  and  CALCON.  For  example: 

1.  It  the  first  100  objective  gradients  appeared  to  be  correct  in  an  earlier  run, 
and  if  you  have  just  found  a  bug  in  CALCFG  that  ought  to  fix  up  the  101-th 
component,  then  you  might  as  well  specify 

START  OBJECTIVE  VERIFICATION  AT  VARIABLE  101  . 

Similarly  for  columns  of  the  Jacobian  matrix. 

2.  If  the  first  100  variables  occur  nonlinearly  in  the  constraints,  and  if  the  next 
50  variables  are  nonlinear  only  in  the  objective,  then  CALCFG  must  set  the  first 
100  components  of  G(*)  to  zero,  but  these  hardly  need  to  be  verified.  The  above 
data  card  would  again  be  appropriate. 

For  a  normal  verification  (at  the  first  feasible  point),  these  keywords  are 
effective  only  if  a  positive  VERIFY  LEVEL  is  specified.  The  default  values  are 
k  =  1  and  /  =  r»i,  the  appropriate  number  of  nonlinear  variables. 

For  an  emergency  verification  (at  the  end  of  a  run  in  which  the  linesearch 
procedure  appears  to  have  failed),  all  objective  and  constraint  gradients  will  be 
checked,  unless  a  negative  VERIFY  LEVEL  was  specified.  An  exception  is  if  the 
“cheap”  objective  check  proves  to  be  satisfactory;  in  this  case  the  specified  k  and 
l  will  be  used  for  checking  individual  objective  gradients. 
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TARGET  OBJECTIVE  VALUE  t 

This  option  is  no  longer  supported. 


SUPPRESS  PARAMETERS 

Normally  MINOS  prints  the  SPECS  file  as  it  is  being  read,  and  then  prints 
a  complete  list  of  the  available  keywords  and  their  final  values.  The  SUPPRESS 
PARAMETERS  option  tells  MINOS  not  to  print  the  full  list.  (Both  SUP  and  PARA 
are  significant.) 


VERIFY  OBJECTIVE  GRADIENTS 
VERIFY  LEVEL  1 


VERIFY  CONSTRAINT  GRADIENTS 
VERIFY  LEVEL  2 


VERIFY  YES 
VERIFY  GRADIENTS 
VERIFY  LEVEL  3 

VERIFY  NO 

VERIFY  LEVEL  0  (default) 

VERIFY  LEVEL  -1 

The  VERIFY  keyword  refers  to  a  finite-difference  check  on  the  computed 
gradient  components  in  the  objective  function  or  the  nonlinear  constraints.  The 
various  options  should  be  self-explanatory.  For  example,  the  nonlinear  objective 
gradients  (if  any)  will  be  verified  if  either  VERIFY  OBJECTIVE  or  VERIFY  LEVEL 
1  is  specified.  Similarly,  both  the  objective  and  the  constraint  gradients  will  be 
verified  if  VERIFY  YES  or  VERIFY  LEVEL  3  or  just  VERIFY  is  specified. 

Gradients  will  be  verified  at  the  first  point  reached  that  satisfies  the  linear 
constraints  and  the  upper  and  lower  bounds.  The  current  linearization  of  the 
nonlinear  constraints  must  also  be  satisfied.  Unfortunately,  if  the  programmed 
gradients  are  seriously  incorrect,  there  may  not  be  any  point  at  all  that  satisfies 
the  resulting  (incorrect)  linearized  constraints.  In  this  case  an  emergency  gradient 
check  is  performed  before  MINOS  terminates  the  current  problem.  If  the  non¬ 
linear  functions  are  not  well  defined  at  the  final  (infeasible)  point,  a  fatal  error 
may  result. 


§4 


KEYWORDS 


23 


An  emergency  gradient  check  will  also  occur  if  MINOS  is  about  to  terminate 
because  of  a  linesearch  failure. 

If  you  do  not  want  an  emergency  check  in  either  of  these  situations,  you 
should  specify  VERIFY  LEVEL  -1  . 

Verification  of  the  objective  gradient  occurs  in  two  stages.  An  inexpensive 
test  on  all  components  is  first  performed,  using  two  calls  to  subroutine  CALCFG. 
A  more  reliable  test  then  occurs  on  individual  gradient  components,  within  the 
ranges  specified  by  the  START  and  STOP  keywords.  A  key  of  the  form  “OK”  or 
“BAD”  indicates  whether  or  not  each  component  appears  to  be  correct. 


I 
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This  file  specifies  most  of  the  constraint  data  for  a  particular  problem,  in  the  so- 
called  MPS  format  common  to  commercial  mathematical  programming  systems. 
A  commercial  matrix  generator  may  be  used  to  construct  the  file,  whether  or 
not  there  are  any  nonlinear  constraints. 


5.1  The  ROWS  Section 

The  names  of  the  nonlinear  constraints  must  be  listed  first  in  the  ROWS  section, 
and  their  order  must  be  consistent  with  the  computation  of  the  components  of 
f(x)  and  J(x)  in  subroutine  CALCON. 

Note  that  the  objective  function  is  not  included  in  this  list.  If  the  objective 
contains  some  linear  terms  ( cTx  +  dTy  in  equation  (1)),  then  c  and  d  should  be 
specified  in  an  objective  row,  and  the  name  of  this  row  should  appear  somewhere 
after  the  list  of  nonlinear  row  names.  For  simplicity  we  suggest  that  objective 
rows  be  listed  last  in  the  ROWS  section. 

If  the  objective  function  is  nonlinear  and  defined  wholly  by  subroutine 
CALCFG,  there  need  not  be  any  objective  row  in  the  MPS  file. 


5.2  The  COLUMNS  Section 

Recall  that  the  constraint  matrix  is  of  the  form 

Jk  M 

•  jA-2 

where  J k  is  the  Jacobian  matrix.  The  variables  associated  with  Jk  and  A2  must 
appear  first  in  the  COLUMNS  section,  and  their  order  must  be  consistent  with 
the  array  X  in  subroutines  CALCFG  and  CALCON. 

Similarly,  entries  belonging  to  Jk  must  appear  in  an  order  that  is  consistent 
with  their  calculation  in  subroutine  CALCON  (as  stored  in  the  parameter  G). 

For  convenience,  let  the  first  r»i  columns  of  the  constraint  matrix  be 


■  Jk 

'  3\  32  ■ 

•  Jni 

.  a2 

Oi  a2 . . 

•  °m . 

where  fa  is  the  first  column  of  Jk  and  Oi  is  the  first  column  of  A2.  The  coefficients 
of  fa  and  ai  must  appear  before  the  coefficients  of  fa  and  o2  (and  so  on  for  all 
columns).  Usually,  those  belonging  to  fa  will  appear  before  any  in  a1;  but  this 
is  not  essential.  (If  certain  linear  constraints  are  made  nonlinear  at  a  later  date, 
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this  means  that  entries  in  the  COLUMNS  section  will  not  have  to  be  reordered. 
The  corresponding  row  names  will  need  be  moved  towards  the  top  of  the  ROWS 
section,  but  this  is  more  easily  accomplished.) 

If  JACOBIAN  =  DENSE,  the  elements  of  J *  need  not  be  specified  in  the  MPS 
file.  If  JACOBIAN  =  SPARSE,  all  nonzero  elements  of  J ^  must  be  specified.  Any 
variable  coefficients  should  be  given  a  dummy  value,  such  as  zero.  These  dummy 
entries  will  be  reset  by  subroutine  CALCON,  but  they  serve  to  identify  the  location 
of  the  elements. 

In  either  case  (JACOBIAN  =  DENSE  or  SPARSE),  if  some  of  the  Jacobian 
elements  are  constant,  their  correct  values  may  be  specified  in  the  COLUMNS 
section  and  then  they  need  not  be  reset  by  subroutine  CALCON.  This  includes 
values  that  are  identically  zero  —  such  elements  do  not  have  to  be  specified 
anywhere  (neither  in  the  MPS  file  nor  in  CALCON).  In  other  words,  Jacobian 
elements  are  assumed  to  be  zero  unless  specified  otherwise. 

Note  that  X  may  not  be  the  same  length  in  subroutines  CALCFG  and  CALCON 
(i.e.  the  parameter  N  may  differ),  in  the  event  that  different  numbers  are  specified 
by  the  NONLINEAR  OBJECTIVE  and  NONLINEAR  JACOBIAN  keywords.  However  the 
shorter  set  of  nonlinear  variables  must  of  course  be  the  same  as  the  beginning 
of  the  longer  set,  and  the  ordering  of  variables  in  the  COLUMNS  section  must 
match  both  sets. 

A  nonlinear  objective  function  will  often  involve  variables  that  occur  only 
linearly  in  the  constraints.  In  this  case  we  recommend  that  these  objective 
variables  be  placed  after  the  Jacobian  variables  in  the  COLUMNS  section,  since 
this  will  keep  the  Jacobian  as  small  as  possible. 


5.3  The  RHS  Section 

The  vectors  b i  and  i>2  in  (7)  and  (8)  may  be  regarded  as  a  normal  right-hand-side 
vector  b.  Only  the  nonzero  coefficients  of  b  need  to  be  specified.  They  may 
appear  in  any  order. 

The  MPS  file  may  contain  several  RHS  vectors.  A  particular  one  may  be 
specified  in  the  SPECS  file.  Otherwise  the  first  RHS  will  be  used;  in  this  case, 
if  the  name  field  is  blank,  the  vector  will  be  given  the  name  RHS. 

If  b  =  0,  a  card  with  RHS  in  columns  1-3  must  appear  as  usual,  but  no  rhs 
coefficients  need  follow.  A  dummy  vector  will  be  constructed,  and  again  it  will 
be  given  the  name  RHS. 


Specifying  Xo . 

The  name  LAGRANGE  is  reserved  for  a  special  RHS  vector  whose  entries  will  be 
used  to  define  Lagrange- multiplier  estimates  for  the  nonlinear  constraints.  These 
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will  be  used  as  Xo  in  the  objective  function  for  the  first  major  iteration.  This 
facility  should  be  used  whenever  possible,  since  the  accuracy  of  the  multiplier 
estimates  can  often  have  a  significant  effect  on  the  rate  of  convergence  of  the 
optimization  process.  For  any  given  constraint,  if  you  happen  to  know  that  the 
optimal  multiplier  is  going  to  be  negative  (say),  an  entry  of  -1.0  will  probably 
be  better  than  the  default  value  of  zero. 

Entries  in  the  LAGRANGE  RHS  may  be  interspersed  with  entries  for  the  true 
RHS.  Any  appearing  in  linear  rows  will  be  counted  but  otherwise  ignored. 

Note  that  LAGRANGE  estimates  will  be  used  to  define  Xo  even  if  a  starting 
basis  is  provided.  (This  is  in  contrast  to  entries  in  an  INITIAL  bounds  set  (section 
5.5),  which  will  be  used  only  for  a  cold  start.)  It  is  therefore  important  to  revise 
the  MPS  file  whenever  new  information  comes  to  hand,  e.g.  from  the  solution 
obtained  at  the  end  of  an  earlier  run. 


5.4  The  RANGES  Section 

Nonlinear  rows  may  be  ranged  in  the  same  manner  as  linear  rows.  Since  the 
method  for  specifying  ranges  is  difficult  to  remember,  the  following  example  will 
be  useful.  If  the  first  constraint  is  called  CONI  and  is  of  the  form 

*i  <  fHx)  +  a\y  <  ult 

one  way  of  specifying  it  in  the  MPS  file  is  as  follows: 

ROVS 
L  CONI 


RHS 

RHS1  CONI  tfj 


RANGES 

RNG1  CONI  u  i  —  /i 


Note  that  ranges  typically  make  a  problem  easier  to  solve,  since  they  confine  the 
solution  to  a  smaller  region.  Strangely  enough,  they  are  not  often  used  by  linear 
programmers  even  when  reasonable  values  are  known  in  advance.  For  nonlinear 
programs,  we  recommend  that  range  constraints  be  used  whenever  possible. 
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Again  we  recommend  very  strongly  that  upper  and  lower  bounds  be  placed  on 
variables  whenever  sensible  values  are  known.  Even  if  they  are  not  essential 
(e.g.,  to  avoid  singularities  in  some  of  the  functions  /*( z)),  they  can  only  help 
by  reducing  the  size  of  the  feasible  region. 

In  many  cases  it  is  very  easy  to  place  meaningful  bounds  on  all  variables.  For 
example,  if  you  know  that  all  components  of  x  and  y  lie  in  the  range  ( — 100, 100), 
you  should  put 

LOWER  BOUND  -100.0 

UPPER  BOUND  100.0 

in  the  SPECS  file.  Similarly,  uniform  bounds  of  the  form  Xj  >  10~5  may  be 
necessary  to  avoid  evaluating  log  x3-  at  zero  (say),  and  there  will  always  be  some 
reasonable  upper  bound  on  the  variables,  such  as  Xj  <  1000.  In  this  case, 

LOWER  BOUND  1.0E-5 

UPPER  BOUND  1000.0 

will  suffice.  If  some  of  the  elements  of  x  and  y  are  bounded  differently,  suitable 
values  can  be  specified  in  a  bounds  set  in  the  MPS  file. 


Specifying  (z0,  yo)- 

The  name  INITIAL  is  reserved  for  a  special  bounds  set,  which  may  be  used  to 
specify  a  starting  point  (zo>yo)  (or  some  of  its  components)  when  no  basis  file  is 
available. 

Remember  that  several  bounds  sets  may  exist  in  the  MPS  file,  and  if  an 
INITIAL  bounds  set  exists,  it  must  be  the  last. 

MINOS/AUGMENTED  allows  both  linear  and  nonlinear  variables  to  be 
initialized.  Also,  those  specified  with  an  FX  indicator  will  become  superbasic  at 
the  specified  values,  whether  or  not  the  values  are  feasible  with  respect  to  the 
upper  and  lower  bounds.  (These  points  relax  two  restrictions  on  page  29  of  the 
MINOS  User’s  Guide.) 

The  best  set  of  variables  to  initialize  depends,  of  course,  on  the  application. 
In  some  cases,  as  many  nonlinear  variables  as  possible  should  be  initialized 
(especially  Jacobian  variables  —  see  below).  However,  this  should  not  be  at  the 
expense  of  forming  a  very  large  set  of  superbasic  variables.  Bear  in  mind  that  the 
SUPERBASICS  LIMIT  and  the  HESSIAN  DIMENSION  should  always  be  larger  than 
the  number  of  FX  indicators.  Hence  for  very  large  problems,  Jacobian  variables 
should  be  given  first  preference,  followed  by  any  “critical”  nonlinear  objective 
variables,  followed  perhaps  by  some  important  linear  variables. 

For  Jacobian  variables,  the  values  specified  are  particularly  important  be¬ 
cause  they  will  be  used  to  evaluate  the  initial  constraint  functions  and  gradients, 
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regardless  of  feasibility.  Suppose  the  first  5  variables  XJAC1,  XJAC2,  . . .,  XJAC5 
are  involved  in  the  nonlinear  constraints,  and  that  their  upper  and  lower  bounds 
have  previously  been  specified  to  be  2  <  XJACj  <  25.  The  data  cards 


FX 

INITIAL 

XJAC1 

10.0 

L0 

INITIAL 

XJAC2 

20.0 

UP 

INITIAL 

XJAC3 

30.0 

will  have  an  effect  that  can  be  summarized  as  follows:  the  numerical  values  specify 
a  point  x0  which  defines  the  first  subproblem,  while  the  indicators  determine  a 
starting  point  for  solving  that  subproblem.  (These  points  would  be  the  same  if 
FX  were  used  for  all  Jacobian  variables.) 

In  this  case: 

1.  io  is  the  point  (10, 20, 30,  2, 2).  This  will  be  used  in  the  first  call  to  subroutine 
CALCON  to  evaluate  f(x 0)  and  J{x o),  and  these  quantities  will  be  used  (along  with 
X0)  to  define  the  first  subproblem  (5)-(8).  Note  that  the  functions  must  be  well 
defined,  even  though  the  value  for  XJAC3  lies  above  its  upper  bound. 

2.  The  FX  indicator  means  that  XJAC1  should  retain  its  value  of  10  at  the 
beginning  of  iteration  1.  It  will  initially  be  superbasic  at  this  value. 

3.  The  L0  indicator  means  that  XJAC2  will  be  moved  to  its  lower  bound,  2,  at 
the  start  of  the  first  iteration.  However,  it  may  be  selected  by  one  of  the  CRASH 
options  to  become  basic,  and  in  this  case  its  initial  value  is  unpredictable.  (If 
this  arbitrariness  sounds  troublesome,  use  CRASH  OPTION  2,  4  or  0.) 

4.  The  UP  indicator  means  that  XJAC3  will  be  moved  to  its  upper  bound,  25,  but 
again  it  may  be  selected  by  CRASH  to  become  basic  at  an  unpredictable  value. 

5.  XJAC4  and  XJAC5  take  default  values  as  described  below. 

The  main  point  about  Jacobian  variables  is  that  all  numerical  values  are 
relevant,  whether  specified  explicitly  by  the  FX,  L0  and  UP  indicators  or  by 
default.  For  other  variables,  only  the  values  on  FX  cards  are  used. 

If  the  number  of  FX  cards  has  reached  the  SUPERBASICS  LIMIT,  any  further 
FX  indicator  will  be  treated  as  an  UP  or  a  L0,  depending  on  which  bound  is  closer 
to  the  specified  numerical  value. 

By  default,  any  variables  not  specified  in  the  INITIAL  bounds  set  will  be 
made  nonbasic  at  their  upper  or  lower  bounds  (the  smallest  in  absolute  value), 
or  at  zero  if  a  variable  is  free.  Ties  are  broken  in  favor  of  lower  bounds. 
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5.6  Comment  Cards 


MPS  FILE 
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Any  card  in  the  MPS  file  may  contain  the  characters  “*  ”  in  columns  1-4  (i.e. 

an  asterisk  followed  by  three  blanks),  and  arbitrary  data  in  columns  5-12, 15-22 
and  40-47.  Such  cards  will  be  treated  as  comments.  They  will  appear  in  the 
input  listing  but  will  otherwise  be  ignored. 

Restriction:  Columns  25-36  and  50-61  should  preferably  be  blank.  If  not,  they 
must  contain  valid  numerical  data  whenever  non-comment  cards  would  do  so. 
(This  is  a  limitation  of  portable  Fortran;  data  cannot  be  read  under  one  format 
and  then  re-read  under  another.) 
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6.  BASIS  FILES 
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6.1  Cold  Start 

If  there  are  no  basis  files  available,  any  values  specified  in  the  INITIAL  bounds  set 
of  the  MPS  file  will  be  loaded  (see  section  5.5),  the  corresponding  initial  Jacobian 
will  be  evaluated,  and  then  one  of  the  CRASH  options  will  be  used  to  obtain  a 
starting  basis. 

For  large  problems,  CRASH  OPTION  2  is  often  to  be  recommended.  As  many 
variables  as  possible  (particularly  nonlinear  variables)  should  be  assigned  values 
by  means  of  FX  indicators  in  the  INITIAL  bounds  set.  They  will  then  be  held 
temporarily  at  the  specified  values,  and  efficient  linear-programming  iterations 
will  be  used  to  optimize  any  remaining  linear  variables  as  much  as  possible. 
There  will  be  no  calls  to  the  nonlinear  function  subroutines  during  this  phase. 

If  you  happen  to  know  that  your  problem  is  not  particularly  nonlinear  (so 
there  will  not  be  many  superbasic  variables  in  the  optimal  solution),  it  may  be 
preferable  to  use  CRASH  OPTION  1. 

The  remaining  CRASH  options  have  been  implemented  only  for  complete¬ 
ness.  They  may  be  useful  in  special  circumstances. 


6.2  Warm  Start 

A  solution  may  be  saved  on  a  NEI  BASIS  FILE  as  described  in  the  User’s  Guide 
[2],  and  this  may  be  used  as  an  OLD  BASIS  FILE  to  start  a  subsequent  run, 
as  long  as  the  dimensions  of  the  problem  have  not  changed.  When  nonlinear 
constraints  are  present,  the  list  of  superbasic  variables  at  the  end  of  a  NEI  BASIS 
FILE  is  extended  to  include  all  basic  nonlinear  variables.  (This  is  the  set  of  values 
j,  Zj  on  page  61  of  the  User’s  Guide.)  The  final  Jacobian  matrix  can  then  be 
reconstructed  exactly  for  a  restart. 

PUNCH  and  INSERT  files  may  be  used  as  documented  in  the  User’s  Guide. 
(They  already  include  values  for  basic  nonlinear  variables.)  Similarly  for  DUMP 
and  LOAD  files. 
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7.  EXAMPLES 

Two  example  problems  are  described  here  to  illustrate  the  subroutines  and  data 
required  to  specify  a  nonlinear  program,  and  the  corresponding  output  produced 
by  MINOS/AUGMENTED. 

The  first  example  is  small,  dense  and  highly  nonlinear;  it  shows  how  the 
Jacobian  matrix  may  be  handled  most  simply  when  there  are  very  few  nonlinear 
constraints  or  variables.  The  second  example  has  both  linear  and  nonlinear 
constraints,  and  illustrates  most  of  the  features  that  will  be  present  in  large-scale 
applications  where  it  is  essential  to  treat  the  Jacobian  as  a  sparse  matrix. 


7.1  Tilt  Problem  MHW4D  (Wright  [8],  example  4,  starting  point  D) 

Statement  of  problem: 

minimize  (ix  —  l)2  +  (zi  —  x2)2  +  {x2  —  a*)3  +  (z3  —  z4)4  +  (z4  —  z5)4 

subject  to  X\  -}-  x2  +  *3  =  3n/2  2, 

22  —  x\  +  *4  =  2^2  —  2, 

XiXs  =  2. 

Starting  point:  x0  =  ( — 1, 2, 1,  — 2,  — 2) 

Notes: 

1.  The  subroutines  below  happen  to  include  code  for  a  second  problem  (Wright 
[8],  example  9).  The  parameter  NPROB  is  used  to  branch  to  the  appropriate 
calculations. 

2.  In  subroutine  CALCFG,  F  is  the  value  of  the  objective  function  and  G  contains 
the  corresponding  5  partial  derivatives. 

3.  In  subroutine  CALCON,  F  is  an  array  of  constraint  function  values  and  the  rows 
of  G  contain  the  derivatives  for  each  constraint.  In  this  example  the  Jacobian 
is  best  treated  as  a  dense  matrix,  so  G  is  a  two-dimensional  array.  Note  that 
several  elements  of  G  are  actually  zero;  they  do  not  need  to  be  explicitly  set. 

4.  Subroutine  CALCON  will  be  called  before  subroutine  CALCFG.  The  parameter 
N8TATE  is  used  to  print  a  message  on  the  very  first  entry  to  CALCON.  This  is  just 
a  matter  of  good  practice,  since  it  is  often  convenient  to  compile  MINOS  and 
the  function  routines  into  an  executable  code  file,  and  it  is  easy  to  forget  which 
particular  function  routines  were  used. 
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5.  The  SPECS  file  shown  contains  keywords  that  should  in  general  be  specified 
for  small,  dense  problems  (i.e.  ones  whose  default  values  would  not  be  ideal). 

6.  The  MPS  file  should  follow  the  SPECS  file  in  the  normal  input  stream,  since 
it  is  not  specified  to  be  on  any  other  file. 

7.  The  COLUMNS  section  of  the  MPS  file  contains  only  the  names  of  the  vari¬ 
ables,  since  they  are  all  “nonlinear” ,  and  because  there  are  no  linear  constraints. 

8.  The  RHS  section  should,  if  possible,  include  estimates  of  the  Lagrange 
multipliers.  The  more  nonlinear  a  problem,  the  more  valuable  they  are. 

9.  The  BOUNDS  section  specifies  only  the  initial  point.  (Uniform  bounds  on 
the  variables  are  given  in  the  SPECS  file.) 

10.  Since  FX  indicators  are  used  for  the  INITIAL  bounds,  the  SUPERBASICS 
LIMIT  needs  to  be  at  least  5  in  this  case. 

11.  This  example  has  several  local  minima,  and  the  performance  of  MINOS/ 
AUGMENTED  is  very  dependent  on  the  initial  point  x0.  See  [4]  or  [8]  for 
computational  details. 
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(Example  1)  Computation  of  the  objective  function: 


EXAMPLE  1 


SUBROUTINE  CALCFG (  MODE , N , X , F , G , NS TATE , NPROB  ) 

IMPLICIT  REAL*8 (A-H , 0-Z ) 

REAL*8  X(N)  ,G(N) 

MHW  4 

IF  (NPROB  .NE.  4)  GO  TO  500 
T 1  =  X (1 )  -  1.0 
T2  «  X(l)  -  X (2 ) 

T3  *  X (2 )  -  X (3) 

T4  =  X (3 )  -  X (4) 

T5  -  X(4)  -  X (5 ) 

F  «  T 1**2  +  T2**2  +  T3**3  +  T4**4  +  T5**4 
G (1 )  *  2. 0*(T1  +  T2) 

G (2 )  ■=  -2 . 0*T2  +  3. 0*T3**2 
G (3 )  *  -3. 0*T3**2  +  4.0*T4**3 
G (4 )  -  -4 . 0*T4**3  +  4. 0*T5**3 
G(5)  =  -4. 0*T5**3 
RETURN 

MHW  9 

500  T I  *  DSIN(X(5)  -  X(3)) 

T2  -  DCOS (X(5)  -  X(3)) 

F  =  10. 0*X ( 1 )*X (4 )  +  X (1 )**3  *  X (2 )  -  6.0*X(2)**2  *  X 
1  +  9.0*T 1  +  X (2 )**3  *  X(4)**2  *  X(5)**4 

G ( 1 )  -  10.0*X(4)  +  3.0*X(1)**2  *  X (2 ) 

G (2 )  -  X ( 1 )**3  -  12.0*X(2)*X(3) 

1  +  3.0*X(2)**2  *  X (4 )**2  *  X (5 )**4 

G(3)  =  -6.0*X(2)**2  -  9.0*T2 

G (4 )  =  10.0*X(1)  +  2.0*X(2)**3  *  X(4)  *  X(5)**4 

G (5 )  =  9. 0*T2  +  4.0*X(2)**3  *  X(4)**2  *  X(5)**3 

RETURN 

C  END  OF  CALCFG  FOR  MHW4AND9 
END 


non  o  o  non 
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(Example  1)  Computation  of  the  constraint  functions: 


§7 


SUBROUTINE  CALCON(  MODE ,M , N , N JAC , X, F , G , NSTATE , NPROB  ) 
IMPLICIT  REAL*8 (A-H.O-Z) 

REAL*8  X(N),F(M),G(M,N) 

MHW  4 

IF  (NSTATE  .EQ.  1)  WRITE (6,  1000)  NPROB 

IF  (NPROB  .NE.  4)  GO  TO  500 

F(1 )  =  X(l)  +  X (2 )**2  +  X  (3)**3 

G  (1 , 1 )  =  1.0 

G (1 , 2)  =  2 . 0*X  (2 ) 

G (1 , 3)  =  3. 0*X (3 )**2 

F(2)  -  X (2 )  -  X(3)**2  +  X(4) 

G(2,2)  -  1.0 
G(2, 3)  -  -2. 0*X(3 ) 

G  (2 , 4)  =  1.0 

F(3)  *=  X(1  )*X(5) 

G  (3 , 1 )  -  X  (5 ) 

G (3, 5)  -  X (1 ) 

RETURN 

MHW  9 

500  F (1 )  «  X(1 )**2  +  X (2 )**2  +  X(3)**2  +  X(4)**2  +  X(5)**2 

G (1 , 1 )  =  2 . 0*X ( 1 ) 

G(1 , 2)  =  2.0*X(2) 

G(l,3)  -  2.0*X(3) 

G(l, 4)  -  2. 0*X(4 ) 

G(l,5)  -  2. 0*X(5 ) 

F(2)  -  X (1 )**2*X (3 )  +  X (4 )*X (5 ) 

G(2, 1)  -  2.0*X(1 )*X(3) 

G(2, 3)  *=  X(1  )**2 
G (2 , 4)  -  X (5 ) 

G(2, 5)  -  X(4 ) 

F(3)  -  X(2)**2*X(4)  +  10.0*X(1 )*X(5) 

G(3, 1)  -  10.0*X(5) 

G(3, 2)  -  2.0*X(2)*X(4) 

G (3, 4)  =  X(2)**2 
G(3,5)  -  10.0*X(1) 

RETURN 

1000  FORMAT (/  36H  THIS  IS  PROBLEM  MHW4AND9.  NPROB  »,  13) 

C  END  OF  CALCON  FOR  MHW4AND9 
END 
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(Example  1)  The  SPECS  file  and  the  MPS  file 


EXAMPLE  1 
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BEGIN  MHV  4D 


MINIMIZE 

ROWS 

20 

COLUMNS 

20 

ELEMENTS 

50 

UPPER  BOUND 

5.0 

LOWER  BOUND 

-5.0 

NONLINEAR  CONSTRAINTS  3 
NONLINEAR  VARIABLES  5 

PROBLEM  NO .  4 

JACOBIAN  DENSE 

MAJOR  ITERATIONS  15 

MINOR  ITERATIONS  20 

PENALTY  PARAMETER  10.0 

PRINT  LEVEL  (JFLXI)  10101 

SUPERBASICS  6 

HESSIAN  DIMENSION  6 

LINESEARCH  TOLERANCE  C.l 
VERIFY  OBJECTIVE  GRADIENT 
VERIFY  CONSTRAINT  GRADIENTS 

CRASH  OPTION  1 

ITERATIONS  100 

END 


NAME  MKW  4D 

ROWS 
E  CONI 
E  CON  2 
E  CON  3 
COLUMNS 
XI 
X2 
X3 
X4 
X5 

RHS 


RHS 

CONI 

6.24263 

RHS 

CON  2 

0.82842 

RHS 

CON  3 

2.0 

BOUNDS 

FX  INITIAL 

XI 

-l.C 

FX  INITIAL 

X2 

2.0 

FX  INITIAL 

X3 

1.0 

FX  INITIAL 

X4 

-2.0 

FX  INITIAL 

X5 

-2.0 

ENDATA 
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(Example  1)  Solution  obtained  by  MINOS/AUGMENTED: 
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PROBLEM  NAME  MHW  4D 
STATUS  OPTIMAL  SOLN 


OBJECTIVE  VALUE  2. 7871 880860D+01 
ITERATION  21  SUPERBASICS  2 


OBJECTIVE  (MIN) 

RHS  RHS 

RANGES 

BOUNDS 

SECTION  1  -  ROUS 


NUMBER 

...ROW.. 

AT 

. . -ACTIVITY. . . 

SLACK  ACTIVITY 

..LOWER  LIMIT. 

..UPPER  LIMIT. 

.DUAL  ACTIVITY 

.  .1 

7 

CONI 

EQ 

6.24263 

0.0 

6.24263 

6.24263 

2.12527 

1 

8 

CON  2 

EQ 

0.82842 

0.0 

0.82842 

0.82842 

1.55378 

2 

9 

CON  3 

EQ 

2.00000 

0.0 

2.00000 

2.00000 

8.93568 

3 

SECTION 

2  -  COLUMNS 

NUMBER 

.COLUMN. 

AT 

...ACTIVITY... 

•OBJ  GRADIENT. 

..LOWER  LIMIT. 

..UPPER  LIMIT. 

.REDUCED  COST. 

M+J 

1 

XI 

BS 

-1.27305 

-11.91292 

-5.00000 

5.00000 

-0.00000 

4 

2 

X2 

SBS 

2.41035 

11.79905 

-5.00000 

5.00000 

-0.00000 

5 

3 

X3 

BS 

1.19486 

5.38957 

-5.00000 

5.00000 

0.00000 

6 

4 

X4 

BS 

-0.15424 

1.55378 

-5.00000 

5.00000 

0.0 

7 

5 

15 

SBS 

-1.57103 

-11.37559 

-5.00000 

5.00000 

-0.00000 

8 

A  * 

RHS 

EQ 

-1.00000 

0.0 

-1.00000 

-1.00000 

-32.42579 

9 

I 
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7.2  Twt  problem  MANNE10  (Mann*  [1],  T  =  10) 
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Statement  of  problem 


maximize 


T 

X>l°g  Ct 

t=  i 


subject  to  ottKht  >  Ct  -f-  It,  1  <  t  <  T,  (nonlinear  constraints) 

Kt+ 1  <  Kt  -)-  It,  1  <  t  <  T,  (linear  constraints) 

gKr  <  /t, 

with  various  ranges  and  bounds. 

The  variables  here  are  Kt,  Ct  and  It,  representing  capital,  consumption  and 
investment  during  T  time  periods.  This  problem  is  described  more  fully  in  [4], 
where  results  are  given  for  the  case  T  =  100. 

Notes: 

1.  For  efficiency,  the  Jacobian  variables  Kt  are  made  the  first  T  components  of 
x,  followed  by  the  objective  variables  Ct.  Since  the  objective  does  not  involve 
Kt,  subroutine  CALCFG  must  set  the  first  T  components  of  the  objective  gradient 
to  zero.  The  parameter  N  will  have  the  value  2 T.  Verification  of  the  objective 
gradients  may  as  well  start  at  variable  T  -f-  1. 

2.  For  subroutine  CALCON,  N  will  be  T .  The  Jacobian  matrix  is  particularly 
simple  in  this  example;  in  fact  J(x)  has  only  one  nonzero  element  per  column 
(i.e.  it  is  diagonal).  The  parameter  NJAC  will  therefore  be  T  also  It  is  used  only 
to  dimension  the  array  G. 

3.  NSTATE  enables  B,  AT  and  BT  to  be  initialized  on  the  first  entry  to  CALCON,  for 
subsequent  use  in  both  of  the  function  subroutines.  (Remember  that  the  first 
call  to  CALCON  occurs  before  the  first  call  to  CALCFG.)  The  name  chosen  for  the 
labeled  COMMON  block  holding  these  quantities  must  be  different  from  the  other 
COMMON  names  used  by  MINOS,  as  listed  in  section  3.3. 

4.  The  COMMON  block  I0C0MM  is  one  of  the  blocks  used  by  MINOS. 

5.  NSTATE  is  also  used  to  produce  some  output  on  the  final  cal)  to  CALCON,  at 
the  optimal  solution. 

6.  The  SPECS  file  uses  keywords  that  you  should  become  familiar  with  before 
running  large  problems.  Other  values  will  be  appropriate  for  other  applications. 

7.  The  MPS  file  specifies  a  sparse  T  by  T  Jacobian  in  the  top  left  corner  of 
the  constraint  matrix.  An  arbitrary  value  of  0. 1  has  been  used  for  the  nonzero 
variable  coefficients.  A  zero  or  blank  numeric  field  would  be  equally  good. 
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(Example  2)  Calculation  of  the  objective  function: 
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SUBROUTINE  CALCF G (  MODE ,  N ,  X ,  F ,  G , NSTATE , NPROB  ) 
IMPLICIT  REAL*8 (A-H,0-Z) 

REAL*8  X  (N )  ,G  (N ) 

COMMON  /MANNE  /  B, AT ( 100 ) ,BT  ( 1 00 ) 

NT  =  N/2 
F  -0.0 
DO  50  J  =  1,  NT 
XCON  -  X (NT4J ) 

F  -  F  4  BT ( J ) *DL0G (XCON ) 

G (J )  =  0.0 

G (NT4J )  -  BT ( J ) /XCON 
50  CONTINUE 
RETURN 


C 

C 


END  OF  CALCFG  FOR  MANNE 
END 


no  non  o  non 
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(Example  2)  Calculation  of  the  constraint  functions: 


EXAMPLE  2 
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SUBROUTINE  CALCON (  MODE , M , N , N JAC , X , F , G , NSTATE , NPROB  ) 
IMPLICIT  REAL*8 (A-H,0-Z) 

REAL*8  X (N ) ,F (M) ,G (NJAC ) 

COMMON  /IOCOMM/  IREAD, IPRINT 

COMMON  /MANNE  /  B,AT(100) ,BT(100) 

C 

NT  =  N 

IF  (NSTATE  .NE.  1)  GO  TO  100 
FIRST  ENTRY 


ONE  =  1.0 
GROW  =0.03 
BETA  =  0.S5 
XK0  =3.0 
XC0  =  0.S5 
XI0  =  0.05 
B  =  0.25 
BPROB  =  NPROB 

IF  (NPROB  .NE.  1)  B  =  BPROB/IOO.O 
WRITE (IPRINT,  1000)  B 

A  =  (XC0  +  XI0)/XK0**B 
GFAC  =  (ONE  +  GROW)** (ONE  -  B) 

AT  ( 1 )  =  A*GFAC 
BT ( 1 )  =  BETA 
DO  10  J  =  2,  NT 

AT ( J )  =  AT ( J-l )*GFAC 
BT ( J )  =  BT (J-l )*BETA 
10  CONTINUE 

BT (NT )  =  BT (NT ) / (ONE  -  BETA) 
NORMAL  ENTRY 


100  DO  150  J  =  1,  NT 
XKAP  =  X(J) 

FJ  =  AT (J )*XKAP**B 
F  ( J  )  =  FJ 
G  (J )  =  B*FJ/XKAP 
150  CONTINUE 

IF  (NSTATE  .NE.  2)  RETURN 

FINAL  ENTRY 
C  - 

WRITE(IPRINT,  2000)  (F(J),  J  =  1,  NT) 

RETURN 

C 

1000  FORMAT (//  30H  THIS  IS  PROBLEM  MANNE.  B  =,  F8.3) 

2000  FORMAT ( //  32H  FINAL  NONLINEAR  FUNCTION  VALUES  /  (5F12.5)) 
C  END  OF  CALCON  FOR  MANNE 
END 
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(Example  2)  The  SPECS  file: 
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BEGIN  MANNEIO 
MAXIMIZE 

NONLINEAR  CONSTRAINTS  10 
NONLINEAR  JACOBIAN  VARS  10 
NONLINEAR  OBJECTIV  VARS  20 

OBJECTIVE  -  CALCFG 
PROBLEM  NUMBER  1 

MPS  FILE  5 
ROWS  100 
COLUMNS  100 
ELEMENTS  200 
UPPER  BOUND  100.0 

COMPLETION  FULL 
JACOBIAN  SPARSE 
LAGRANGIAN  YES 
MAJOR  ITERATIONS  10 
MINOR  ITERATIONS  20 
PENALTY  PARAMETER  0.1 

FEASIBILITY  TOL  1.0E-6 
DJ  TOLERANCE  1.0E-6 
ROW  TOLERANCE  1.0E-6 
RADIUS  OF  CONVERGENCE  0.01 

SUPERBASICS  10 
HESSIAN  DIMENSION  10 
LINESEARCH  TOLERANCE  0.1 
VERIFY  GRADIENTS 


START  OBJECTIVE  GRADIENT  CHECK  AT  VARIABLE  11 
STOP  CONSTRAINT  GRADIENT  CHECK  AT  VARIABLE  5 


CRASH  OPTION  1 
ITERATIONS  100 
MULTIPLE  PRICE  5 
PRINT  LEVEL  (JFLXI)  101 
SOLUTION  YES 


CALL  FUNCTION  ROUTINES  WHEN  OPTIMAL 
END  MANNEIO 


(Example  2)  The  MPS  file: 


NAME 

ROWS 

G  MON 001 
G  MON 00 2 
G  MON 00 3 
G  MON 004 
G  MON  00  5 
G  MON 00 6 
G  MON 00 7 
G  MON008 
G  MON 00 9 
G  MONOIO 
L  CAP002 
L  CAP003 
L  CAP004 
L  CAP005 
L  CAP006 
L  CAP007 
L  CAP008 
L  CAP009 
L  CAP010 
L  TERMINV 
COLUMNS 


MANNE10 
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KAPQ01 

MONOOl 

.1 

CAP001 

1.0 

KAP001 

CAP002 

-1.0 

KAP002 

MON 00 2 

.1 

CAP002 

1.0 

KAP002 

CAP003 

-1.0 

KAP003 

MON 00 3 

.1 

CAP003 

1.0 

KAP003 

CAP004 

-1.0 

KAP004 

MON 004 

.1 

CAP004 

1.0 

KAP004 

CAP005 

-1.0 

KAP005 

MON 00 5 

.1 

CAP005 

1.0 

KAP005 

CAP006 

-1.0 

KAP006 

MON 00 6 

.1 

CAP  006 

1.0 

KAP006 

CAP007 

-1.0 

KAP007 

MON 00 7 

.1 

CAP007 

1.0 

KAP007 

CAP008 

-1.0 

KAP008 

MON 008 

.1 

CAP008 

1.0 

KAP008 

CAP009 

-1.0 

KAP009 

MON 00 9 

.1 

CAP009 

1.0 

KAP009 

CAP010 

-1.0 

KAP010 

MONOIO 

.1 

CAP010 

1.0 

KAP010 

TERMINV 

.03 

CONOOl 

MONOOl 

-1.0 

C0N002 

MON 00 2 

-1.0 

CON003 

MON 00 3 

-1.0 

CON 00 4 

MON004 

-1.0 

CON 00 5 

MON 00 5 

-1.0 

CON 00 6 

MON 00 6 

-1.0 

CON 00 7 

MON007 

-1.0 

CON 00 8 

MON 00 8 

-1.0 

CON 00 9 

MON 00 9 

-1.0 

C0N010 

MONOIO 

-1.0 

INV001 

MONOOl 

-1.0 

CAP002 

-1.0 

INV002 

MON002 

-1.0 

CAP003 

-1.0 

INV003 

MON 00 3 

-1.0 

CAP004 

-1.0 

INV004 

MON004 

-1.0 

CAP005 

-1.0 

INV005 

MON 00 5 

-1.0 

CAP006 

-1.0 

INV006 

MON 006 

-1.0 

CAP007 

-1.0 

INV007 

MON 00 7 

-1.0 

CAP008 

-1.0 

1NV008 

MON 00 8 

-1.0 

CAP009 

-1.0 

INV009 

MON009 

-1.0 

CAP010 

-1.0 

INV010 

MONOIO 

-1.0 

CAP01 1 

-1.0 

INV010 

TERMINV 

-1.0 

42  MINOS/AUGMENTED 
The  MPS  file,  continued: 


RHS 

* 


* 

* 

THE  RHS 

IS  ZERO 

LAGRANGE 

MON 001 

1.0 

RANGES 

RANGE  1 

MONOIO 

10.0 

BOUNDS 

FX 

BOUND  1 

KAP0G1 

3.05 

LO 

BOUND  1 

KAP002 

3.05 

LO 

BOUND  1 

KAP003 

3.05 

LO 

BOUND  1 

KAPQ04 

3.05 

LO 

BOUND  1 

KAP005 

3.05 

LO 

BOUND  1 

KAP006 

3.05 

LO 

BOUND  1 

KAP007 

3.05 

LO 

BOUND  1 

KAP008 

3.05 

LO 

BOUND  1 

KAP009 

3.05 

LO 

BOUND  1 

KAPC10 

3.05 

LO 

BOUND] 

CON  00 1 

.95 

LO 

BOUND  1 

CON  00  2 

.95 

LO 

BOUND] 

CON  00  3 

.95 

LO 

BOUND  1 

CON  00  4 

.95 

LO 

BOUND  1 

CONOC5 

-95 

LO 

BOUND  1 

C0N006 

•  95 

LO 

BOUND! 

CON  00  7 

■  95 

LO 

BOUND  1 

CON 00 6 

.95 

LO 

BOUND  1 

C0NG09 

.95 

LO 

BOUND  1 

CONOIO 

.95 

LO 

BOUND  1 

INV001 

.05 

LO 

BOUND! 

INV0C2 

.05 

LO 

BOUND  1 

INVG03 

.05 

LO 

BOUND! 

I NVG04 

.05 

LO 

BOUND  1 

INVG05 

.05 

LO 

BOUND  1 

INVOOfc 

.05 

LO 

BOUND  1 

1NV007 

.05 

LO 

BOUND  1 

INV008 

.05 

LO 

BOUND  1 

INV009 

.05 

LO 

BOUND  1 

1NV010 

.05 

UP 

BOUND] 

IN  v  OOP 

.1.2 

UP 

BOUND  1 

INV009 

.114 

UP 

BOUND! 

INV010 

.116 

FX 

INITIAL 

KAP002 

3.1 

FX 

INITIAL 

KAP003 

3.-’ 

FX 

INITIAL 

KAP004 

3.3 

FX 

INITIAL 

KAP005 

3.4 

FX 

INITIAL 

KAP006 

3.5 

FX 

INITIAL 

KAP007 

3.6 

FX 

INITIAL 

KAP008 

3.7 

FX 

INITIAL 

KAP009 

3.  B 

FX 

INITIAL 

KAP010 

3.9 

ENDATA 


MON010 

TERMINV 


10.0 

20.0 


§7 

(Example  2)  Output  from  MINOS/AUGMENTED: 


EXAMPLE  2 


N  I  »0S  —  VERSION  4.0  MAY  1580 


PROBLEM  SPEC  1F1CAT  IONS 


OOOO.  BECIN  MANSE  10 

0CO1.  MAXIMIZE 

0002.  NONLINEAR  CONSTRAINTS  10 

0005.  NONLINEAR  JACOBIAN  VARS  10 

0004.  NONLINEAR  OBJLCTtV  VARS  20 

0005. 

0006.  OBJECTIVE  -  CALCFG 

0007.  PROBLEM  NUMBER  1 


0007.1 

0007.2  MPS  FILE  5 
0009.  ROWS  100 
0010.  COLUMNS  100 
0011.  ELEMENTS  200 
0012.  UPPER  BOUND  100. 0 
0  013. 

0014.  COMPLETION  FULL 
0015.  JACOBIAN  SFARSE 
0016.  LACRANCIAN  YES 
0017.  MAJOR  ITERATIONS  10 
0016.  MINOR  ITERATIONS  20 
0019.  PENALTY  PARAMETER  0.1 
0020. 

0021.  FEASIBILITY  TOL  I.OE-6 
0022.  DJ  TOLERANCE  l.GE-6 
0023.  ROW  TOLERANCE  J.OL-6 
0024.  RADIUS  OF  CONVERCENCE  C.C1 
0025. 

0026.  SUPERBASICS  10 
0027.  HESSIAN  DIMENSION  10 
002 £ .  LINESEARCH  TOLERANCE  C. 1 
0029.  VERIFY  CRAD1ENTS 


0029.1  START  OBJECTIVE  CRAD1ENT  CHECK  AT  VAR lABLt  II 

0029-2  STOP  CONSTRAINT  GRADIENT  CHECK  AT  VARIABLE  5 


00  3C. 

0031.  CRASH  OPTION  1 
0032.  ITERATIONS  100 
0033.  MULTIPLE  PRICE  5 
0034.  PRINT  LEVEL  tJFLX! )  101 
0035.  SOLUTION  YES 


0035.1  CALL  FUNCTION  ROUTINES  WHEN  OPTIMAL 

0036.  END  MANNE10 


PARAMETERS 


MPS  INPUT  DATA. 

ROW  LIMIT .  100 

COLUMN  LIMIT .  100 

ELEMENTS  LIMIT  (COEFFS)  200 

FILES. 

MPS  FILE  {INPUT  FILE)..  5 

SOLUTION  FILE .  0 

INSERT  FILE .  0 

PUNCH  FILE .  0 

FREQUENCIES. 

LOC  ITERATIONS .  I 

SAVE  NEW  BASIS  HAP .  100 

LP  PARAMETERS. 

ITERATIONS  LIMIT .  100 

CRASH  OPTION .  1 

WEIGHT  ON  OBJECTIVE....  G.G 

NONLINEAR  PROBLEMS. 

NONLINEAR  CONSTRAINTS..  1C 

NONLINEAR  JACOBIAN  VARS  10 

NONLINEAR  OBJECT IV  VARS  20 

PROBLEM  NUMBER .  I 

AUGMENTED  LACRANCIAN. 

JACOBIAN .  SPARSE 

LACRANCIAN .  YES 

PENAL1Y  PARAMETER .  J.GOD-OI 

MISCELLANEOUS . 

LL  ROW  TOLERANCE .  1.000-03 

LL  COL  TOLERANCE .  G.  10000 

Lt  NCO  TOLFRANCt .  U.5000C 


LIST  LIMIT .  0 

ERROR  MESSAGE  LIMIT....  10 

PHANTOM  ELEMENTS .  0 

OLD  BASIS  FILE  (MAP)...  0 

NEW  BASIS  FILE  (MAP)...  0 

BACKUP  BASIS  FILE .  0 

LOAD  FILE .  0 

CHECK  ROW  ERROR .  30 

FACTORIZE  (INVERT) .  60 

FEASIBILITY  TOLERANCE..  I.OOD-06 

DJ  TOLERANCE .  1.00D-06 

PIVOT  TOLERANCE .  I.49D-06 

‘UPERBAS ICS  UNIT .  10 

HESSIAN  DIMENSION .  10 

LINESEARCH  TOtERAKCE...  0.10000 

Rf.LUCED-CRAUIEKT  101... .  0.20000 

MAJOR  ITERATIONS  UNIT.  10 

MINOR  ITERATIONS  LIMIT.  20 

COMM.  FT  ION .  HU. 

PRINT  LEVEL..  (JUKI  )...  1CI 

DF  BIG  LEVEL .  G 


LOVER  BOUND  DEFAULT -  O.C 

UPPER  BOUND  DEFAULT -  1.00E+02 

A1J  TOLERANCE .  I.OOE-lO 

(CARD  READER) .  5 

(PRINTER) .  6 

(SCRATCH  FILE) .  8 

DUMP  FILE .  C 

CYCLE  LIMIT .  I 

CYCLE  TOl  E RANGE .  0.0 

PARTIAL  PRICE  FACTOR...  1 

MULTIPLE  PRICE .  5 


DERIVATIVE  LEVEL .  3 

VERIFY  LEVEL .  3 

DIFFERENCE  INTERVAL -  2.5BD-08 

CONJUGATE -GRADNT  METHOD  I 

RADIUS  OF  CONVERGENCE..  1. 000-02 

ROW  TOLERANCE . l.GOD-Ofe 


IMBED .  YES 

PRINT  SPIKES .  NO 


NUMBER  C-r  BONUS  OF  LORI  AYAIIAMF  FOR  WURRSPAI  f 


P  704 


44  MINOS/AUGMENTED 

Output,  continued: 


§7 


j  i 

input  list inc 


1  NAME  MANNER- 

2  RONS 

23  COLUMNS 

XXXX  WARNING  -  NO  LINEAR  ObJECIlVE  Ft  K<  1  U.N  EuUNL 

XAXJC  NON-EXISTENT  ROW  SPECIFIED  —  (.A  POO  I  —  ENTRY  1CNORIU  IN  LINE  24 

XXXX  NON-EXIST ENT  ROW  SPECIFIED  —  CAPC1 1  —  ENTRY  IGNORED  IN  LINE  63 

63  RHS 

66  * 

67  •  THE  RHS  IS  ZERO 

68  • 

70  R a NOES 

12  BOUNDS 

IIS  ENDA1A 


NAMES  SELECTED 


OBJECTIVE 

RHS 

RANCES 

BOUNDS 


CALCFC  (MAX) 
RHS 

Range  1 
BOUND  I 


MATRIX  STATISTICS 


TOTAL  NORMAL 
ROWS  20  IP 
COLUMNS  30  0 


EREF  FIXED  BOUNDED 

0  0  2 

0  l  2* 


NO.  Of  MATRIX  ELEMENTS 
NO.  Of  REJECTED  COEFFS 
BIGGEST  AND  SMALLEST  COEFFS 


5V  DENSITY  S.S It 

0  AIJTOL  1 . GOOOOE-1 0 

1  .COOOOL+OO  3.00000E-02 


(EXCLUDING  OBJ  AND  RHS) 


XXXX  TOTAL  NO.  OF  ERRORS  DURING  INPUT  2 


LENGTH  OF  ROW-NAME  HASH  TABLE  211 

COLLISIONS  DURING  TABLE  LOOKUP  0 

NO.  OF  JACOBIAN  ENTRIES  SPECIFIED  10 

NO.  OF  LACRANCE  MULTIPLIERS  SPECIFIED  2 

NO.  OF  INITIAL  BOUNDS  fROCESSED  9 

NO.  OF  SUPERBASICS  SPECIFIED  S 


I 

! 


EXAMPLE  2  45 


Output,  continued: 


CRASH  OPTION  1 
FREE  RONS  0 


THIS  IS  PROBLEM  MANNE.  B  -  0.250 


PASS 2  (E  RMS) 


MULTIPLIER  ESTIMATES 


I . GOOOOOOD+OO  0.0 

o.c  o.c 


0.0 

I.0GC0000D+O1 


FACTOR 12 E 
SLACKS 
PA  BUMPS 
LU  BUMPS 


0  —  INFUSIBLE.  NUN  . 


ITERATION  0  INFUS  I 

NONLINEAR  10  CLEMS  TO 

CORE  REQD  579  L  LIMIT  1864 

A I J  ELCMS  20  L  ELEMS  21 

1  SUM  -  9.S9996542SD-04 


ITN  PH  PP  NOPT  DJ/RC  +SBS  -SBS  -BS  STEP  PIVOT  NSPK 
I  4  0  0  0.0  0  1C  30  1 . ID* 00  -3. CD-02  0 


FUSIBLE  SOLUTION.  OBJECTIVE  ■ 


OBJECTY  0.0 
DENSITY  7.5 
U  LIMIT  3728 
U  ELEMS  I 


U  NINF  SINF /OBJECTIVE 
I  1  5.59956543D-04 


NFC  NSB  RIM  H-CONDM  CONV 
1  6  1  0  0.0  TTTT 


VERIFICATION  OF  OBJECTIVE  GRADIENTS  RETURNED  BY  SUBROUTINE  CALCFC. 

COMPUTED  CTP  VIA  CALCFC  4. 57304926069D-0)  ( . 2P54AP80395D-01 
DIFFERENCE  APPROXIMATION  4.573049161920-01  8. 28544668426D-01 

OBJECTIVE  GRADIENTS  SEEM  TO  BE  OK. 


11  5.766500000-01 

12  9.53940674D-0! 

13  9.861 523590-01 

14  1.019077060400 

15  1.052733250400 

16  I. CP 7 145 720400 

17  1.122336740400 

18  1.158326200400 

19  1.228474020400 

20  1.213952050400 


9. 7271 2833D-01 
9.46075581D-01 
£. 6941430 5D-01 
7 . S92586P3D-01 
/. 350208540-01 
6. 761 66796D-0 1 
6.2221 7209D-01 
5. 72740533D-CI 
5. 13034322D-01 
5.664256450400 


DIFFERENCE  APPROXN 

9. 72707224D-01  OK 
5. 4606991 9D-01  OK 
8.694050660-01  OK 
7.99253841D-01  OK 
7.350163630-01  OK 
6.76162674D-01  OK 
6.22213412D-01  OK 
5. 72737041D-0 I  OK 
5. 1 30312560-01  OK 
9.P6424F 160400  OK 


OBJECTIVE  GRADIENTS  11  THRU  20  SEEM  TO  BE  OK. 


VERIFICATION  OF  CONSTRAINT  GRADIENTS  RETURNED  BY  SUBROUTINE  CALC  OK. 


1  3.050000190400  1.21D-07 

2  3.100000380400  1.220-07 


3  3.1 9999981 D400  1.250-07 

4  J. 300000 I 9D400  1 . 280-07 


ELEMENT  NO.  ROW  JACOBIAN  VALUE  DIFFERENCE  APPROXN 

I  1  E.4I 51 661 7D-02  8.415166400-02  OK 


5  3.299999620400  1.31D-07  5  5 

CONSTRAINT  GRADIENTS  I  THRU  5  SEEM  TO  BE  OK. 


6.499516170-02  6.499516160-02  OK 
6. 485569010-02  6. 485568980-02  OK 


8. 477852950-02  8.47  78531  ID-02  OK 

6.475S83E6D-C2  6.47598374D-02  OK 


CHOLESKY  FACTOR  CF  HESSIAN  RESET  TO  I. 


2400  2.SD-02 
2400  1 . 50-02 

4400  9.5D-03 

RC  TOLS  REDUCED.  TOLRC  ■ 

540  0  4.5D-C3 

640  0  2.60-03 

7*0  0  1.3D-03 

8*0  0  l.iD-03 

9*00  7.30-0* 

10  4  0  0  5.6P-0S 

11  4  0  0  7.,t)-06 

12  4  C  0  4.60-07 


0  4. 70-01  0.0  l 

11  I.5D-0I  1 .00400  I 

0  1.0D40C  0.0  2 


0  6.50-01  C.O 
0  1.00400  0.0 

0  1.00400  0.0 

0  2.2IHOO  O.C 
0  1.61)400  O.C 

0  I.0D400  O.C 

U  1.2D400  O.C 


0  2.6697332*0400 
0  2*669629830400 
0  2.670026870400 


2.67007306D400 
2.670051680400 
2.670100070*00 
2.670I0392D400 
2.6701  1  1  760400 
2.6701 12310400 
2.6701 I232D400 
2.6701  I 222D+O0 


8  *  *  2.30400  TTFF 
7  2  2  2. 3D*00  TTFF 
7  *  4  2.50400  TTTF 


7  4  4  3.00400  FFFF 

7  4  4  3. (SHOO  FFFF 

7  4  4  3.ID400  FFFF 

7  4  4  3.2IHOO  FFFF 

7  4  4  3.  3IHOO  FFFF 

7  4  4  3.40400  FFFF 

7  4  *  3.5D400  TFTF 

7  4  4  3.40400  TTTT 


BIGGEST  "  0,0  **»RH  *G  •  4.57  70-07  NORM  PI  •  I.452D40I  NORM  X  •  3.9000400 

END  06  MAJOR  ITN  I  -  OPTlMAI  tt'I.K  AT  MINOR  UK  12  -  HUAI  17 NS  •  |J 


46  MINOS/AUGMENTED 
Output,  continued: 


§7 


START  Of  MAJOR  ITK  2  -  PENALTY  PARAMETER  -  I.COP-OJ 
MULTIPLIER  ESTIMATES 


1.01104930*00  9.  21846880-01  t .  5895W30-OI  7.5182982D-01  7.2995650L-01 

6.72899230-01  6.2024976P-01  5- 7] 646990-01  5.26763310-01  9.86425650*00 

ROW  ERROR  AFTER  RELINEARIZaT lO*  -  2.3493D-06 

RELATIVE  CHANCE  IN  MULTIPLIERS  -  3.3281D-01 

FACTORIZE  2  DEMAND  0  ITERATION  12  INFEAS  0  OBJECTV  2.6701123160400 

SLACKS  0  LINEAR  9  NONLINEAR  lj  ELEMS  33  DENSITY  t.2 

P4  BUMPS  0  SPIKES  0  CORE  RCQO  SfeO  L  LIMIT  4196  U  LIMIT  1396 

Lll  BUMPS  0  SPIKES  C  AlJ  ELEMS  33  I.  ELEMS  21  U  ELEMS  I  p  ELEMS  i  O.C 

ITN  12  —  FEASIBLE  SOLUTION.  OBJECTIVE  -  2. 670O95339D+O0 

ITN  PH  PP  NOPT  OJ/RC  *SBS  -SBS  -BS  STEP  PIVOT  NSPK  I.  U  NINP  SIM/OBJECTIVE  NfC  NSB  RIM  H-CONPN  CONV 
n  4  0  0  2.00-03  ooo  l.CD+OO  O.G  0  21  10  2. 67009598D*00  21  7  4  4  3.30400  TTPT 

RO  TOLS  REDUCED.  TOLRG  -  1. 4930-05 

14  4  0  0  B.7D-07  0  0  0  1.0P4O0  0.0  0  21  1  0  2 •  67009399D400  22  7  4  4  3.3D+0O  FFTT 

BlCGEST  DJ  -  0.0  NORM  RC  -  8.687D-07  NORM  PI  •  1.493D401  NORM  X  •  3.667D400 

END  OF  MAJOR  ITN  2  -  OPTIMAL  SOLN  AT  MINOR  ITN  2  -  TOTAL  ITNS  *  14 


START  OF  MAJOR  ITN  3  -  PENALTY  PARAMETER  -  1.00D-01 

MULTIPLIER  ESTIMATES 


1.0106338D400  9. 31931040-01  6- 5926408D-01  /. S21671 ID-01  7.3O2O9760-OI 
6.72993960-01  6. 20151300-01  5.7I34097E-01  5.2624756D-01  9.86433030*00 

ROW  ERROR  AFTER  RELINEARIZATION  -  5.S570D-06 

RELATIVE  CHANGE  IN  MULTIPLIERS  -  1.41I5D-04 

PENALTY  PARAMETER  DECREASED  TO  0.0 


FACTORIZE  3  DEMAND  0  ITERATION  14  INFFAS  0  OBJECTV  2.6700959850+00 

SUCKS  0  LINEAR  9  NONLINEAR  II  ELEMS  33  DENSITY  8.2 

P4  BUMPS  0  SPIKES  0  CORE  REQO  580  L  LIMIT  4663  U  LIMIT  932 

LV  BUHPS  0  SPIKES  0  AlJ  ELEMS  33  L  ELEMS  2!  U  ELEMS  I  F  ELEMS  0  0.0 

ITN  14  —  FEASIBLE  SOLUTION.  OBJECTIVE  -  2. 670096032D400 

NORM  RC  IS  ALREADY  SMALL  9.6790-07  -  RETURN  TO  PHASE  3.  NORM  Pi  ■  1.493D+01 

BIGGEST  DJ  -  0.0  NORM  RC  -  9.6790-07  NORM  PI  -  1.493D401  NORM  X  *  3.8670+00 

END  OF  MAJOR  ITN  3  -  OPTIMAL  SOLN  AT  MINOR  ITN  0  -  TOTAL  ITKS  •  14 


EXIT  —  OPTIMAL  SOLUTION  FOUND. 

NO*  OF  ITERATIONS  14  OBJECTIVE  VALUE  2* 6700960319077D+00 

NO.  OP  MAJOR  ITERATIONS  3  LINEAR  OBJECTIVE  O.C 

OBJECTIVE  FUNCN  AND  GRADIENT  CALLS  21  NONLINEAR  OBJECTIVE  2- 670096031 907 ?D4©0 

CONSTRAINT  FUNCN  AND  GRADIENT  CALLS  24  PENALTY  PARAMETER  0.0 

NORM  OF  X  3.8670*00  NORM  Of  PI  1.4930*01 

NO.  OF  SUPERBASICS  ?  NORM  OF  REDUCED  GRADIENT  9.679D-07 


FINAL  NORLINIAR  FUNCTION  VALUES 

1.02445  1.05420  1.06738  1.11947  1*15233 

1-16612  1.22076  1.25632  I.292H  1.32994 


§7 

Output,  continued: 


EXAMPLE  2 


HOB  LEU 

NAME  MANNE10 

OBJECTIVE  VALUE 

2.67009603190400 

STATUS 

OPTIMAL  SOLN 

ITERATION  14 

SUPERBASICS  7 

OBJECTIVE  CALCPC 

(MAX) 

RHS 

BUS 

RANGES 

UNGEi 

BOUNDS 

BOONE  1 

SECTION 

I  -  ROUS 

amt  ex 

...MW., 

AT 

...ACTIVITY. 

..  SUCK  ACTIVITY 

..LOWER  LIMIT.  .. 

UPPER  LIMIT. 

.DUAL  ACTIVITY 

..I 

32 

NON 001 

LL 

0.0 

0.0 

0.0 

NONE 

1.01063 

1 

33 

HON 00 2 

LL 

0.0 

0.0 

0.0 

NONE 

0.93193 

2 

34 

MOW 003 

LL 

0.0 

0.0 

O.C 

NONE 

0.65926 

3 

35 

MON004 

LL 

O.G 

0.0 

0.0 

NONE 

0.79217 

4 

36 

KONGO 5 

LL 

C.O 

0.0 

0.0 

NONE 

0.73021 

5 

3? 

HON 006 

LL 

0.0 

0.0 

0.0 

NONE 

0.67299 

6 

38 

MON 00 7 

LL 

O.C 

o.e 

O.C 

NONE 

0.62015 

7 

39 

HON 00 6 

LL 

0.0 

o.o 

0.0 

NONE 

0.57134 

e 

40 

MON 009 

LL 

0.0 

o.o 

0.0 

NONE 

0.52625 

9 

41 

MONO 10 

LL 

0.0 

o.o 

0.0 

10.00000 

9.66433 

10 

42 

CAT 002 

UL 

0.0 

o.o 

NONE 

0.0 

-1.01063 

11 

43 

CAP003 

UL 

0.0 

o.o 

NONE 

0.0 

-0.93193 

12 

44 

CAP004 

UL 

O.G 

O.o 

NONE 

0.0 

-0.85926 

13 

45 

CAP  00  5 

UL 

0.0 

o.o 

NONE 

O.G 

-0.79217 

14 

46 

CAP006 

UL 

0.0 

o.o 

NONE 

0.0 

-0.73021 

15 

47 

CAP007 

UL 

C.O 

O.C 

NONE 

0.0 

-0-67299 

16 

48 

C A POO 6 

LX 

O.C 

O.o 

NONE 

C.C 

-0.62015 

17 

49 

CAP009 

UL 

0.0 

O.o 

NONE 

0.0 

-0.57134 

18 

50 

CAP010 

UL 

0.0 

0.0 

NONE 

0.0 

-0.52625 

19 

51 

TERMINV 

UL 

0.0 

O.o 

-20.00000 

0.0 

-10.73212 

20 

SECTION 

NUMBER 

2  -  COLUMNS 

.COLUMN.  AT 

..ACTIVITY... 

.OBJ  GRADIENT. 

..LOVER  LIMIT. 

..UPPER  LIMIT. 

.REDUCED  COST. 

M4J 

1 

KAP001 

EO 

3.05000 

C, 00000 

3.05000 

3.05000 

1.09566 

21 

2 

KAP002 

BS 

3.12665 

0.00000 

3,05000 

100.00000 

0.00000 

22 

3 

LA  POO  3 

SBS 

3.21443 

0.00000 

3.05000 

100.00000 

0.00000 

23 

4 

KAP004 

SBS 

3.30400 

0.00000 

3.05000 

100.00000 

0.00000 

24 

5 

MAPCO  5 

SBS 

3.395 22 

o. 00000 

3.C5000 

100.00000 

0.00000 

25 

6 

KAF006 

SBS 

3.48788 

0.00000 

3.05000 

100.00000 

0.00000 

26 

7 

LA  POO  7 

SBS 

3.58172 

0.00000 

3.05000 

100.00000 

-0.00000 

2) 

8 

LA  POO  8 

SBS 

3.67643 

0.00000 

3.05000 

100.00000 

-o.ooooc 

2P 

9 

KAP009 

SBS 

3.77158 

0.00000 

3.05000 

100.00000 

-0.00000 

29 

10 

KAP01 0 

BS 

2 . 6666  7 

0.00000 

3.05000 

100.00000 

0.00000 

30 

11 

CONOOl 

LL 

0.95000 

1 . ooooo 

0.95000 

100.00000 

-0.01063 

31 

12 

CON 00 2 

BS 

0.96842 

0.93193 

0.95000 

100.00000 

0.0 

32 

13 

CON 00 3 

BS 

0.99780 

0.65926 

0.95000 

100.00000 

0.0 

33 

14 

CON 00 4 

BS 

1.02620 

0.79217 

0.95000 

100.00000 

0.0 

34 

15 

CON005 

BS 

1.05967 

0.73021 

0.95000 

100.00000 

0.0 

35 

16 

CON 00 6 

BS 

1.09227 

0,67299 

0.95000 

100.00000 

0.0 

36 

17 

CON 00 7 

BS 

1.12606 

0.62015 

0.95000 

100.00000 

O.C 

3? 

18 

CON 00 8 

BS 

1.16116 

0.57134 

0.95000 

100.00000 

0.0 

38 

19 

CON009 

BS 

1.19763 

0.52625 

0.95000 

100.00000 

0.0 

35 

20 

CONOIO 

BS 

1.21394 

9.66433 

0.95000 

100.00000 

0.0 

40 

21 

IMV001 

65 

0.07663 

0.0 

C. 05000 

100.00000 

0.0 

4) 

22 

INV002 

BS 

0.08778 

0.0 

0.05000 

100.00000 

0.0 

42 

2  J 

INV003 

BS 

0.08957 

0.0 

0.05000 

100.00000 

O.G 

43 

24 

1KV004 

BS 

0.09122 

C.C 

C.C3000 

100.00000 

O.C 

44 

25 

IKV005 

BS 

0.09266 

0.0 

0.(5000 

100.00000 

0.0 

45 

26 

1NV006 

BS 

0.09385 

O.G 

0.C5000 

100.00000 

0.0 

46 

27 

1NV007 

BS 

0.09471 

0.0 

0.05000 

100.00000 

0.0 

47 

2€ 

1NV00B 

BS 

0.09515 

C.C 

0.05000 

0.11200 

O.C 

48 

29 

JNV009 

BS 

0.09508 

0.0 

0.05000 

0.11400 

0.0 

49 

30 

INV010 

UL 

0.11600 

O.n 

0.05000 

0.11800 

0.66779 

50 

A  31 

RMS 

IQ 

-1.00000 

o.o 

-1.00000 

-1.00000 

0.0 

51 
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consistency  with  MPS  file,  18,  24 
examples,  34,  39 
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Column  ordering,  implicit,  24 
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Convergence  conditions,  7 
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F  (*) ,  parameter  of  CALCON,  9-10 
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Formulation  of  nonlinear  problems,  2 

Full  completion  (accurate  solution  of  subproblems),  14 
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G(*),  parameter  of  CALCFG,  8-9 
G(*),  parameter  of  CALCON,  9-11 
Global  optima,  3 

HESSIAN  DIMENSION,  4 

Inequality  constraints,  5 
Infeasible  problems,  see  §4.2  of  [4] 

Initial  point  xo,  1,  27-28 
INITIAL  bounds  set  in  MPS  file,  27-28 
sequence  of  data,  2 

Input  to  MINOS,  examples  of,  35,  40-42 

Jacobian  matrix,  definition,  5 
computation  of,  9-11 
constant  coefficients,  10,  11,  25 
sparsity  pattern,  17,  24-25 
JACOBIAN  option  (DENSE  or  SPARSE),  9-11,  17 

Lagrange  multipliers  X*,  6 
initial  estimate  X0,  6,  25-26 
LAGRANGE  rhs  vector  in  MPS  file,  25-26 
LAGRANGIAN  option  (YES  or  NO),  6,  17 
Linear  approximation  to  nonlinear  constraints,  5 
Linear  programming,  1 
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Major  iterations,  5 
MAJOR  ITERATIONS  limit,  17 
MINOR  ITERATIONS  limit,  17-18 
MODE,  parameter  of  CALCFG  and  CALCON,  8,  9 
MPS  file,  2,  24-29 
examples,  35,  41-42 
MULTIPLE  PRICE  option,  18 

NJAC,  parameter  of  CALCON,  10,  11 
Nonlinear  constraints,  5 
Nonlinear  variables,  5 

NONLINEAR  CONSTRAINTS  and  VARIABLES,  18 
NPROB,  parameter  of  CALCFG  and  CALCON,  9,  10 
NSTATE,  parameter  of  CALCFG  and  CALCON,  9,  10 

Optimum  solutions,  local  and  global,  3 
Ordering  of  constraints  and  variables,  5,  18,  24-25 
Output  from  MINOS,  examples,  36,  43-47 
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Partial  completion,  14 
Penalty  parameter  p,  6 
PENALTY  PARAMETER,  18 
PIVOT  TOLERANCE,  19 
PRINT  LEVEL  options,  19-20 
PRINT  SPIKES  option,  20 
Problem  forms  solved  by  MINOS,  3-5 
Problem  formulation,  2-3 
PROBLEM  NUMBER,  9,  10 

RADIUS  OF  CONVERGENCE,  20 
Ranges  on  general  constraints,  5,  26 
RANGES  section  of  MPS  file,  26 
Restarting  previous  runs,  30 
Restrictions  on  problem  characteristics,  3-4 
RHS  section  of  MPS  file,  25 
ROW  TOLERANCE,  21 
ROWS  section  of  MPS  file,  24 

Scaling  of  data  and  variables,  3 
Scope  of  manual,  1 
Sparse  Jacobian  matrix,  6,  10,  17 
SPECS  file,  2,  13 
examples,  35,  40 
Standard  form  for  problems,  5 
START  and  STOP  gradient  verification,  21,  23 
Subproblem,  definition,  6 
Subroutine  names,  reserved,  12 
Superbasic  variables,  4 
SUPERBASICS  LIMIT,  4 
Suppression  of  output,  19,  22 
SUPPRESS  PARAMETERS  option,  22 

TARGET  OBJECTIVE  VALUE,  22 
Test  problems,  31-36,  37-47 
Transformation  of  variables,  2-3 

VERIFY  options  for  checking  gradients,  22-23 

Warm  start,  30 
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ABSTRACT 

MINOS/AUGMENTED  is  a  general  purpose  nonlinear  programming  system, 
designed  to  solve  large-scale  optimization  problems  involving  sparse  linear  and 
nonlinear  constraints.  Any  nonlinear  functions  appearing  in  the  objective  or  the 
constraints  must  be  continuous  and  smooth.  Users  specify  these  functions  and 
their  gradients  using  two  Fortran  subroutines.  The  remaining  constraint  infor¬ 
mation  is  specified  in  standard  MPS  format,  as  for  regular  linear  programming 
models. 

MINOS/AUGMENTED  (alias  MINOS  Version  4.0)  employs  a  projected  aug¬ 
mented  Lagrangian  algorithm  to  solve  problems  with  nonlinear  constraints.  This 
involves  a  sequence  of  sparse,  linearly  constrained  subproblems,  which  are  solved 
by  a  reduced-gradient  algorithm  as  implemented  in  the  earlier  version  of  MINOS. 

This  manual  supplements  Report  SOL  77-9,  the  MINOS  User’s  Guide. 
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